Media-editing application with novel editing tools

ABSTRACT

Some embodiments provide a media-editing application with novel editing tools. The media editing application provides an in-line precision editor that can be opened in the composite display area. In some embodiments, a selection of an edge between two clips expands a composite lane into two lanes, a first lane and a second lane. The first lane is then used to perform edits to the left side of the selected edge, while the second lane is used to perform edits to the right side of the selected edge. In some embodiments, the first lane shows the additional media content available for the clip on the left side of the edge to include. The second lane shows the additional media content available for the clip on the right side of the edge to include. The additional media content is in the source media file, of which a clip represents a portion.

INCORPORATION BY REFERENCE; DISCLAIMER

Each of the following applications are hereby incorporated by reference:application Ser. No. 16/389,639 filed on Apr. 19, 2019; application Ser.No. 13/151,177 filed on Jun. 1, 2011; application Ser. No. 13/151,175filed on Jun. 1, 2011; application Ser. No. 13/154,361 filed on Jun. 6,2011; application No. 61/443,702 filed on Feb. 16, 2011; application No.61/443,704 filed on Feb. 16, 2011; application No. 61/443,707 filed onFeb. 16, 2011; application No. 61/443,692 filed on Feb. 16, 2011; andapplication No. 61/364,797 filed on Jul. 15, 2010. The Applicant herebyrescinds any disclaimer of claim scope in the parent application(s) orthe prosecution history thereof and advises the USPTO that the claims inthis application may be broader than any claim in the parentapplication(s).

BACKGROUND

Digital graphic design, image editing, audio editing, and video editingapplications (hereafter collectively referred to as media contentediting applications or media editing applications) provide graphicaldesigners, media artists, and other users with the necessary tools tocreate a variety of media content. Examples of such applications includeFinal Cut Pro

and Movie

, both sold by Apple, Inc. These applications give users the ability toedit, combine, transition, overlay, and piece together different mediacontent in a variety of manners to create a resulting media project. Theresulting media project specifies a particular sequenced composition ofany number of text, audio, image, and/or video content elements that isused to create a media presentation.

Various media editing applications facilitate such composition throughelectronic means. Specifically, a computer or other electronic devicewith a processor and computer readable storage medium executes the mediaediting application. In so doing, the computer generates a graphicalinterface whereby designers digitally manipulate graphicalrepresentations of the media content to produce a desired result.However, in many cases, the designers experience inconvenience inmanipulating graphical representations of the media content because ofthe shortcomings of the existing applications. Also, it is often notpossible to view the desired result until the designers finishmanipulating the graphical representation.

BRIEF SUMMARY

Some embodiments of the invention provide a media-editing applicationfor creating and editing a media presentation that displays the resultsof edits as the edits are being made to the media presentation. Themedia-editing application displays the movement of media clips of themedia presentation as the media clips are being moved within themedia-editing application to change the media presentation. In someembodiments, the media-editing application is an application thatenables a user to create a composite media presentation from a set ofmedia clips. Through a graphical user interface (GUI) of theapplication, the user specifies the manner in which the media clips arecomposited to create the composite presentation.

The media application of some embodiments includes a timeline, which isa composite display area for displaying media clips that are part of thecomposite media presentation. Specifically, the timeline in someembodiments displays one or more geometric shapes that represent one ormore media clips that are part of the composite presentation. Thetimeline of some embodiments includes a primary lane (also called“spine”) as well as one or more secondary lanes (also called “anchorlanes”). The spine represents a primary sequence of media, which, insome embodiments, does not have any gaps. When a clip is deleted orremoved from the timeline, the media-editing applications automaticallycloses the gap created in place of the clip. The clips in the anchorlanes are anchored to a particular position along the spine (or along adifferent anchor lane). Anchor lanes may be used for compositing (e.g.,removing portions of one video and showing a different video in thoseportions), B-roll cuts (i.e., cutting away from the primary video to adifferent video whose clip is in the anchor lane), audio clips, or othercomposite presentation techniques.

The media editing application of some embodiments also includes a clipbrowser, which displays media clips that can be brought into thetimeline to be part of the media presentation. The media editingapplication also includes a preview display area that displays frames ofmedia clips in the clip browser or in the timeline.

The media-editing application of some embodiments allows the user toedit the media presentation by moving a media clip from one location toanother location within a timeline or from an area out of the timelineinto the timeline. For instance, the user can drag a media clip from amedia browser into the spine or into an anchor lane to anchor the mediaclip to another media clip in the spine. The media-editing applicationdisplays during this drag operation the results of the operation. Forinstance, when a first media clip is dragged into the second media clipsin the spine and collides with the second media clips, the media editingapplication moves the second media clips along the spine to make a roomin the spine for the first media clip. When the first media clip isdragged into an anchored media clip that is in an anchor lane, the mediaediting application moves the anchored media clip into another anchorlane that may be above or below the anchor lane that the anchored mediaclip currently locates. The up or down movement of the anchored clipscan be viewed as dynamic creation of anchor lanes. Some embodimentsdisplays the movement of these media clips as they are being moved.

Some embodiments allow the user of the media-editing application toinsert a media clip between two adjacent media clips within thetimeline. The two adjacent media clips may be anchored clips or clips inthe central compositing lane. Different embodiments provide differentways to insert a media clip between the two adjacent media clips. Someembodiments allow the user to drag a media clip from the clip browser oranother media clip in the timeline into the border between the two mediaclips. The media-editing application of some embodiments allow to add aselected media clip from the clip browser between the two media clips asa playhead is passing close to the border between the two media clips.The two media clips move away from each other to create a space for theclip being inserted between the two clips. Some embodiments display themovement of the two clips as the two clips move to create the space.

Some embodiments shift the media clips (i.e., ripple the media clips inthe timeline) away from a particular point along the timeline betweenthe two media clips as a media clip is being inserted to the point. Inother embodiments, the media-editing application does not ripple themedia clips in the timeline when a media clip is dragged into theparticular point in the timeline. These embodiments overwrite any clipsor portions of clips with the clip being added for the duration of theclip being added starting at the particular point along the timeline.

Some embodiments allow a user of the media-editing application to appenda first media clip to a second media clip in the timeline. The secondmedia may be an anchored clip or a clip in the central compositing lane.Different embodiments provide different ways to append a media clipafter another media clip. Some embodiments allow the user to drag amedia clip from the clip browser or another media clip in the timelineto a right-edge of another media clip which does not have a media clipappended to the right edge. The media-editing application of someembodiments allow to append a selected media clip from the clip browserto the right edge of another media clip as a playhead is passing closeto the right edge. Yet other embodiments allow the user to append aselected media clip from the clip browser after the last media clip inthe central compositing lane by invoking a hot key command.

The media-editing application in some embodiments allows a user todelete a portion of the sequence of media clips in the timeline. In someembodiments, the user may select a full clip or multiple clips. Someembodiments allow the user to select a range that spans several clips.The media-editing application of some embodiments may also allow theuser to select clips in the anchor lanes (rather than just the clips inthe central compositing lane). Some embodiments move the media clipsthat were adjacent to the deleted media clip or range in order to closethe gap created by the deleted media clip or range. Some embodimentsdisplays the movement of the adjacent clips as they are moving to closethe gap.

Some embodiments allow the user to anchor a media clip to another mediaclip in the timeline by selecting a single media clip or a range ofmedia clip(s) from the clip browser and drag it above or below a mediaclip in the timeline. As described above, the media-editing applicationanchors a media clip only to a media clip in the central compositinglane. In other embodiments, the media clip to which another media clipis anchored may be any clip displayed in any lanes in the timeline. Thatis, the media-editing application of these embodiments allows the userto anchor a media clip to a media clip that is in the centralcompositing lane or to a media clip that is anchored to another mediaclip.

In some embodiments, the media-editing application allows the user toadd an anchored clip into the central compositing lane. Some embodimentsallow it by inserting an anchored clip between two adjacent clips orappending the anchored clip after the last media clip displayed in thecentral compositing lane. Also, some embodiments allow the user toreplace a media clip or a selected range over one or more media clips inthe central compositing lane with an anchored clip.

In some embodiments, an anchored media clip is represented as arectangular shape. Each anchored media clip also has an anchor, which isrepresented as a pointer attached to the rectangular shape that connectsthe rectangular shape and a media clip displayed in the centralcompositing lane of a timeline. When a first media clip is anchored to asecond media clip that is displayed in the central compositing lane, theanchor of the first media clip points to a position along the length ofthe second media clip. In some embodiments, the media-editingapplication displays a frame of the media clip represented by thatposition in the preview display area, when the first media clip isselected.

Some embodiments allow the user of the application to select two or moreclips in different anchor lanes of the timeline to move together. Thisallows preserving the timing information between the selected anchoredclips when the clips are placed in different positions along thetimeline. Some embodiments allow the user to create duplicate copies ofone or more media clips displayed in the timeline and place theduplicate copies of the clips in another location within the timeline.The media-editing application preserves relative timing informationbetween two or more anchored media clips when the duplicate copies ofthem are placed in another location within the timeline.

In some embodiments, the media-editing application snaps a first mediaclip to a second media clip when the user drags (e.g., by a cursoroperation) the first media clip close to the second media clip fromeither side of the second media clip. For instance, when the user movesthe first media clip from the right side of the second media clip, themedia-editing application snaps the left edge of the first media clip tothe right edge of the second media clip. Conversely, when the user movesthe first media clip from the left side of the second media clip, themedia-editing application snaps the right edge of the first media clipto the left edge of the media clip. The media-editing applicationapplies this snapping feature to any types of clips in any lanes(central compositing lanes, anchor lanes, etc.) that may be displayed inthe timeline.

As will be described further below, some embodiments may move away thesecond clip to make room for the first media clip. Also, someembodiments may temporarily superimpose the second clip to prompt forreplacement options. Therefore, the media-editing application of someembodiments uses a set of criteria to determine which moving operationto perform. The set of criteria may include the velocity of the firstmedia clip at which the second media clip is moving to the, types ofclips the first and second clips are, the direction in which the firstmedia clip is approaching the second media clip, the origin (e.g., aclip browser, a timeline, etc.) from which the first media clip ismoving, etc.

As described above, an anchored clip's media content is composited with(e.g., overlay, superimpose, mix, etc.) the media content of the mediaclip in a compositing lane. When there are multiple anchored clips at aposition along the timeline, the media content of an anchored clip in anupper anchor lane takes the priority over the media content of a mediaclip in a lower lane in some embodiments. By allowing vertical swapping,the media-editing application provides a simple way of changingpriorities of the anchored clips.

In addition to dynamically displaying different edits to the timeline,the media editing application in some embodiments can dynamicallydisplay the results of such edits in the preview display area. That is,the media editing application in these embodiments has a previewgenerator that can display previews of the media presentation on the flyas media clips are being dragged into and within the timeline. Thisallows the user of the media-editing application to see and hear theresults of the operation while performing them. For instance, as aplayhead moves along the timeline (i.e., as the media-editingapplication playbacks the media presentation), the media-editingapplication displays a composite frame of the media presentationrepresented by a point along the timeline at which the playhead ispositioned currently. When any part of a media clip occupies a pointalong the timeline at the moment the playhead is passing the point, themedia-editing application will factor that media clip into the compositeimage displayed for that point.

Some embodiments provide a media-editing application with novel editingtools. The media editing application provides an in-line precisioneditor. That is, the media-editing application opens the precisioneditor directly in the timeline. For instance, in some embodiments, theselection of an edge between two clips breaks the spine into two tracks,a top track and a bottom track. The top track is then used to performedits to the left side of the selected edge, while the bottom track isused to perforin precision edits to the right side of the selected edge.In some embodiments, the top track shows the additional media contentavailable for the clip that is on the left side of the edge to include.The bottom track shows the additional media content available for theclip on that is the right side of the edge to include. The additionalmedia content is in the source media file, of which a clip represents aportion. In some embodiments, while the precision editor is opened, themedia-editing application displays anchor lanes when any anchored clipexists and allows the user to edit any anchored clips in the displayedanchored lanes.

A media clip in some embodiments includes different types of mediacontent. For instance, an audio and video clip has both video and audiocontent. In some such embodiments, a media clip includes different“tracks” for each type of media content. For instance, an audio contentof an audio clip may include several tracks for several audio channels.Likewise, a video content of a video clip may include several tracksfor, e.g., a foreground video and a background video.

The media-editing application of some embodiments provides anothermulti-tracked editing tool. This multi-track editing tool is also anin-line tool. That is, the media-editing application opens thismulti-tracked editing tool within the timeline as a new “page” in someembodiments. In some embodiments, the media-editing application displaysonly the inside of a selected media clip of which to edit the tracks. Noother media clips of the media presentation be displayed when theselected media clip is opened as a new page for multi-track editing.This multi-tracked editing tool opens different tracks contained in amedia clip in different lanes to allow the user to edit individualtracks of the media clip independently. In some embodiments, themulti-tracked editing tool opens different tracks of a media clip in acentral compositing lane and a set of anchor lanes. Each lane willinclude a track of a media clip in these embodiments. In someembodiments, the media-editing application does not display in the toolany other media clips that were displayed in the timeline before thetool was opened.

A transition effect is an effect used to impact the transition from onemedia clip of a media presentation to the next media clip. There aremany types of transition effects. A common type of transition effect isa fade-out effect where the content of the outgoing media clip (i.e.,the first clip of the two consecutive clips) gradually fades out as thecontent of the incoming media clip (i.e., the second clip of the twoclips) gradually fades in. To apply a transition effect between twoadjacent media clips, both media clips must have additional mediacontent that overlap past the edit point in some embodiments. That is,the incoming media clip has to have media content before its in-pointand the outgoing media clip has to have media content beyond itsout-point. The media-editing application uses these additional mediacontents to show the transitional effect instead of an abrupt cutbetween the two media clips. In the case of a fade-out, the additionalmedia content of the incoming media clip starts to fade in before theclip's in-point (i.e., before the outgoing clip's out-point). Likewise,the additional media content of the outgoing media clip keeps fading outbeyond the clip's out-point (i.e., beyond the incoming clip's in-point).

The media-editing application of some embodiments displays in thetimeline a transition as a rectangle between two media clips. In someembodiments, the media-editing application allows the user of themedia-editing application to adjust the transition by manipulating therectangle. For instance, the media-editing application allows the userto grab either side edges of the rectangle to adjust the points in timeat which the incoming media clip starts to fade in or the outgoing mediaclip finishes fading out. The media-editing application may also allowthe user to perform a rolling edit (i.e., adjusting the in-point of theincoming clip and the out-point of the outgoing media clip at the sametime) by grabbing and dragging a middle portion of the rectangle.

When a transition is applied between two consecutive media clips of themedia presentation, the media-editing application in some embodimentscovers portions of the two media clips with the rectangle such that thecovered portions are not visible in the timeline. In some suchembodiments, the media-editing application displays the rectangletransparently such that each of the two media clips to which thetransition effect is applied is visible. That is, the portions of thetwo media clips that are overlaid with the transition tool are visiblebecause the transition tool is transparent.

As described above, a media clip in some embodiments contains one ormore types of media content (e.g., audio, video, text, image, etc.).When a transition is applied between two adjacent media clips in thetimeline of some embodiments, the media-editing application allows theuser to adjust the transition such that the adjustment affects all typesof media content that the two media clips have. For instance, themedia-editing application allows the user to drag the right side edge ofa transition to adjust the point in time at which both the audio andvideo content of the outgoing media clip finish fading out. In some suchembodiments, the media-editing application also allows the user toadjust different types of media contents separately. For instance, themedia-editing application allows the user to adjust the audio contentsof the two media clips without affecting the video contents of the twoclips by manipulating only the audio portions of the two media clips inthe timeline. Also, the media-editing application allows the user toadjust the video transition independently from the audio transition. Forinstance, the media-editing application allows for moving the videoportion of the transition along the timeline independently from theaudio portion of the transition. Furthermore, the media-editingapplication allows the user to adjust one or more types of mediacontents at the same time and without affecting other contents of themedia clips.

When a media clip in the timeline of some embodiments is trimmed fromits beginning (i.e., when the media clip's in-point is pulled in), themedia-editing application moves the media clips that come after themedia clip being trimmed to the left while leaving the media clips thatcome before the media clip being trimmed static. This results in animpression to the user that the media clip that is being trimmed istrimmed from its ending. That is, this gives an impression that theout-point of the media clip (i.e., the right edge of the clip) that isbeing trimmed is pulled in (to the left). To avoid causing suchimpression, some embodiments of the media application moves to the rightthe media clips that come before the media clip being trimmed from itsbeginning. That is, when a media clip is trimmed on the beginning sideof the media clip, media clips that come before the media clip beingtrimmed moves in the direction of trimming.

The preceding Summary is intended to serve as a brief introduction tosome embodiments of the invention. It is not meant to be an introductionor overview of all inventive subject matter disclosed in this document.The Detailed Description that follows and the Drawings that are referredto in the Detailed Description will further describe the embodimentsdescribed in the Summary as well as other embodiments. Accordingly, tounderstand all the embodiments described by this document, a full reviewof the Summary, Detailed Description and the Drawings is needed.Moreover, the claimed subject matters are not to be limited by theillustrative details in the Summary, Detailed Description and theDrawing, but rather are to be defined by the appended claims, becausethe claimed subject matters can be embodied in other specific formswithout departing from the spirit of the subject matters.

BRIEF DESCRIPTION OF THE DRAWINGS

The novel features of the invention are set forth in the appendedclaims. However, for purposes of explanation, several embodiments of theinvention are set forth in the following figures.

FIG. 1 illustrates a graphical user interface (GUI) of a media-editingapplication of some embodiments.

FIG. 2 illustrates an example of modifying the audio content of a mediaclip that includes both audio and video contents in a timeline of amedia-editing application.

FIG. 3 illustrates a timeline of a media-editing application having twoplayheads.

FIG. 4 illustrates an example of inserting a media clip between twoadjacent media clips in a timeline of a media-editing application.

FIG. 5 illustrates an example of appending a media clip to another mediaclip displayed in the timeline.

FIG. 6 illustrates an example of deleting a selected range of a mediaclip displayed in a timeline of a media-editing application.

FIG. 7 illustrates an example of anchoring a media clip to another mediaclip displayed in a timeline of a media-editing application.

FIG. 8 illustrates an example of anchoring a media clip to another mediaclip displayed in a timeline of a media-editing application.

FIG. 9 illustrates an example of anchoring a media clip to another mediaclip displayed in a timeline of a media-editing application.

FIG. 10 illustrates an example of moving an anchored media clip into acentral compositing lane in a timeline of a media-editing application.

FIG. 11 illustrates an example of moving an anchored clip along ananchor lane in a timeline of a media-editing application.

FIG. 12 illustrates an example of moving multiple anchored clips alongan anchor lane in a timeline of a media-editing application.

FIG. 13 illustrates an example of duplicating anchored clips in anchorlanes of a timeline of a media-editing application.

FIG. 14 illustrates an example of horizontal snapping of two media clipsdisplayed in a timeline of a media-editing application.

FIG. 15 illustrates an example of vertical swapping of two anchoredmedia clips in two different anchor lanes in a timeline of amedia-editing application.

FIG. 16 illustrates a timeline of a media-editing application thatdisplays results of editing operations as the editing operations arebeing performed.

FIG. 17 conceptually illustrates a process of some embodiments forrearranging positions of media clips in a timeline while a media clip isbeing dragged over or extended into different regions of the timeline.

FIG. 18 conceptually illustrates a process of some embodiments forplacing media clips in a timeline when a media clip has moved to a newposition in the timeline.

FIG. 19 illustrates an example of placing media clips in a timeline.

FIG. 20 conceptually illustrates a GUI of a media-editing applicationthat displays results of editing operations in the preview display areaas the editing operations are being performed.

FIG. 21 conceptually illustrates a process for incorporating edits intoplayback of a video sequence in real-time.

FIG. 22 conceptually illustrates an in-line multi-tracked editing toolfor a timeline of a media-editing application.

FIG. 23 conceptually illustrates an example of an in-line precisionediting tool for a timeline of a media-editing application.

FIG. 24 illustrates an example of the movement of an anchored clip inthe middle of a transition modification operation.

FIG. 25 illustrates an example of adjusting a transition between twomedia clips in a timeline of a media-editing application.

FIG. 26 illustrates an example of adjusting a transition between twomedia clips in a timeline of a media-editing application.

FIG. 27 illustrates expanding a space before the first media clip of amedia presentation that is displayed in a timeline of a media-editingapplication.

FIG. 28 conceptually illustrates a process of some embodiments forcreating an asset data structure and a clip data structure referencingthat asset.

FIG. 29 conceptually illustrates an asset data structure for a videoasset, as well as an event data structure for an event that contains thevideo asset.

FIG. 30 conceptually illustrates a process of some embodiments forgenerating an asset ID and storing the ID in the data structure.

FIG. 31 conceptually illustrates a clip data structure that contains asingle asset.

FIG. 32 conceptually illustrates a nested sequence of clip objectscreated by the media-editing application of some embodiments for animported media file.

FIG. 33 conceptually illustrates objects nested in a conceptualtimeline.

FIG. 34 illustrates a timeline of some embodiments.

FIG. 35 conceptually illustrates a subset of the data structures for thesequence illustrated in FIG. 34 .

FIG. 36 conceptually illustrates objects nested in a conceptualtimeline.

FIG. 37 conceptually illustrates a state diagram for a media-editingapplication of some embodiments.

FIG. 38 conceptually illustrates a software architecture of amedia-editing application of some embodiments.

FIG. 39 conceptually illustrates an electronic system with which someembodiments of the invention are implemented.

DETAILED DESCRIPTION

In the following detailed description of the invention, numerousdetails, examples, and embodiments of the invention are set forth anddescribed. However, it will be clear and apparent to one skilled in theart that the invention is not limited to the embodiments set forth andthat the invention may be practiced without some of the specific detailsand examples discussed.

For a media-editing application that creates a composite mediapresentation, some embodiments of the invention provide a novelcompositing display area in which several media clips can be arrangedfor compositing. This novel compositing display area will be referred toas a “timeline” throughout this application unless specified otherwise.This timeline of some embodiments is capable of performing numerousnovel features, some of which will be described in detail further below.

A media clip in some embodiments is a piece of media content. Examplesof types of media content include audio data, video data, audio andvideo data, text data, image/picture data, and/or other media data. Insome embodiments, a media clip can be a video clip or an audio clip. Inother embodiments, a media clip can be a video clip, an audio clip, anaudio and video clip, a sequence of media clips (also referred to as amedia clip sequence), a text clip, a text overlay, a still image orpicture, or any other type of media clip that can be used to create acomposite presentation. In this application, a media clip may also referto the graphical representation of the media clip in the GUI of amedia-editing application of some embodiments.

A media clip that has a temporal component (e.g., audio media clips,video media clips, audio and video media clips, etc.) is further definedby an in-point and an out-point with respect to a source media file insome embodiments. In some such embodiments, the source media file isstored on the computing device on which the media-editing applicationexecutes or on a computing device to which the media-editing applicationhas access. A media clip's in- and out-points define its start and endpoints with respect to the source media file.

The in- and out-points of a media clip can be defined as such to coveran entire source media file or a portion of the source media file insome embodiments. Several media clips can define different in- andout-points with respect to the same source media file such that eachmedia clip has a different media content. For instance, the in- andout-points of a media clip can be defined to be the first half of asource media file while the in and out points of another media clip canbe defined to be the second half of the same source media file.

In some embodiments, a media clip can serve as another media clip'ssource. For instance, the media-editing application allows the user toselect a range (i.e., a length along the length of a graphicalrepresentation of a media clip that corresponds to a duration within themedia clip) and use the selected range like a media clip.

Several detailed embodiments of the invention are described in thesections below. Section I describes various features of the spine-basedtimeline in some embodiments. Section II describes various editoperations that the media-editing application performs on the mediaclips displayed in the spine based timeline. Section III describesdisplaying a preview of a media presentation as the presentation isbeing edited. Section IV then describes several editing tools that themedia-editing application provides. Next, section V describes datastructures of media clips used by some embodiments. Section VI describesthe software architecture of a media-editing application of someembodiments. Finally, Section Vii describes an electronic system thatimplements some embodiments of the invention.

I. Timeline

A. Introduction

FIG. 1 illustrates a graphical user interface (GUI) 100 of amedia-editing application of some embodiments. One of ordinary skillwill recognize that the graphical user interface 100 is only one of manypossible GUIs for such a media-editing application. In fact, the GUI 100includes several display areas which may be adjusted in size, opened orclosed, replaced with other display areas, etc. The GUI 100 includes aclip library 105, a clip browser 110, a timeline 115, a preview displayarea 120, an inspector display area 125, an additional media displayarea 130, and a toolbar 135.

The clip library 105 includes a set of folders through which a useraccesses media clips that have been imported into the media-editingapplication. Some embodiments organize the media clips according to thedevice (e.g., physical storage device such as an internal or externalhard drive, virtual storage device such as a hard drive partition, etc.)on which the media represented by the clips are stored. Some embodimentsalso enable the user to organize the media clips based on the date themedia represented by the clips was created (e.g., recorded by a camera).As shown, the clip library 105 includes media clips from both 2009 and2011.

Within a storage device and/or date, users may group the media clipsinto “events”, or organized folders of media clips. For instance, a usermight give the events descriptive names that indicate what media isstored in the event (e.g., the “New Event 2-8-09” event shown in cliplibrary 105 might be renamed “European Vacation” as a descriptor of thecontent). In some embodiments, the media files corresponding to theseclips are stored in a file storage structure that mirrors the foldersshown in the clip library.

Within the clip library, some embodiments enable a user to performvarious clip management actions. These clip management actions mayinclude moving clips between events, creating new events, merging twoevents together, duplicating events (which, in some embodiments, createsa duplicate copy of the media to which the clips in the eventcorrespond), deleting events, etc. In addition, some embodiments allow auser to create sub-folders of an event. These sub-folders may includemedia clips filtered based on tags (e.g., keyword tags). For instance,in the “New Event 2-8-09” event, all media clips showing children mightbe tagged by the user with a “kids” keyword, and then these particularmedia clips could be displayed in a sub-folder of the event that filtersclips in this event to only display media clips tagged with the “kids”keyword.

The clip browser 110 allows the user to view clips from a selectedfolder (e.g., an event, a sub-folder, etc.) of the clip library 105. Asshown in this example, the folder “New Event 2-8-11 3” is selected inthe clip library 105, and the clips belonging to that folder aredisplayed in the clip browser 110. Some embodiments display the clips asthumbnail filmstrips, as shown in this example. By moving a cursor (or afinger on a touchscreen) over one of the thumbnails (e.g., with a mouse,a touchpad, a touchscreen, etc.), the user can skim through the clip.That is, when the user places the cursor at a particular horizontallocation within the thumbnail filmstrip, the media-editing applicationassociates that horizontal location with a time in the associated mediafile, and displays the image from the media file for that time. Inaddition, the user can command the application to play back the mediafile in the thumbnail filmstrip.

In addition, the thumbnails for the clips in the browser display anaudio waveform underneath the clip that represents the audio of themedia file. In some embodiments, as a user skims through or plays backthe thumbnail filmstrip, the audio plays as well. There are severaltypes of clips. An audio and video clip is a clip that contains bothaudio and video content. An audio clip is a clip that contains onlyaudio content. A video clip is a clip that contains only video content.

Many of the features of the clip browser are user-modifiable. Forinstance, in some embodiments, the user can modify one or more of thethumbnail size, the percentage of the thumbnail occupied by the audiowaveform, whether audio plays back when the user skims through the mediafiles, etc. In addition, some embodiments enable the user to view theclips in the clip browser in a list view. In this view, the clips arepresented as a list (e.g., with clip name, duration, etc.). Someembodiments also display a selected clip from the list in a filmstripview at the top of the browser so that the user can skim through orplayback the selected clip.

The timeline 115 provides a visual representation of a compositepresentation (or project) being created by the user of the media-editingapplication. Specifically, it displays one or more geometric shapes thatrepresent one or more media clips that are part of the compositepresentation. The timeline 115 of some embodiments includes a primarylane (also called a “spine”, “primary compositing lane”, or “centralcompositing lane”) well as one or more secondary lanes (also called“anchor lanes”) above and/or below the primary lane. The spinerepresents a primary sequence of media which, in some embodiments, doesnot have any gaps. The clips in the anchor lanes are anchored to aparticular position along the spine (or along a different anchor lane).Anchor lanes may be used for compositing (e.g., removing portions of onevideo and showing a different video in those portions), B-roll cuts(i.e., cutting away from the primary video to a different video whoseclip is in the anchor lane), audio clips, or other compositepresentation techniques.

Clips placed in the anchor lanes are referred to as “anchored clips.” Asan example, FIG. 1 shows a media clip 175 that is anchored off ofanother media clip 180 in the timeline 115. In some of theseembodiments, media clips can be placed in these anchor lanes to anchoroff of media clips in the central compositing lane 150. Instead of, orin conjunction with, having several levels of media clips that anchoroff the central compositing lane 150, some embodiments allow media clipsto be placed in these anchor lanes and to be anchored off of otheranchored media clips placed in these anchor lanes. To help the userdistinguish the central compositing lane 150 and the anchored lanes inthe timeline 115, some embodiments use different tones for these lanes.For instance, the timeline 115 uses a darker tone for the centralcompositing lane 150 than the tone for the anchored lanes 155, 160, and165.

As shown, the timeline 115 can place different types of media clips inthe same lane (a central compositing lane or an anchored lane). Also,the timeline 115 can place different types of media clips in the anchorlanes above and below the central compositing lane. In other words, thetimeline 115 can place a media clip of any type (e.g., audio clip, videoclip, audio and video clip, etc.) in any lane of the timeline 115.

Also, when there are multiple anchored clips at a position along thetimeline 115, the media content of an anchored clip in an upper anchorlane takes the priority over the media content of a media clip in alower lane in some embodiments. For instance, the video content of themedia clip in the uppermost anchor lane will be the content of thepresentation for the period time along the timeline that the media clipspans.

As with the clips in the clip browser, the user can skim through thetimeline or play back the timeline (either a portion of the timeline orthe entire timeline). In some embodiments, the playback (or skimming) isnot shown in the timeline clips, but rather in the preview display area120.

The preview display area 120 (also referred to as a “viewer”) displaysimages from media files that the user is skimming through, playing back,or editing. These images may be from a composite presentation in thetimeline 115 or from a media clip in the clip browser 110. In thisexample, the user has been skimming through the beginning of clip 140,and therefore an image from the start of this media file is displayed inthe preview display area 120. As shown, some embodiments will displaythe images as large as possible within the display area whilemaintaining the aspect ratio of the image.

The inspector display area 125 displays detailed properties about aselected item and allows a user to modify some or all of theseproperties. The selected item might be a clip, a composite presentation,an effect, etc. In this case, the clip that is shown in the previewdisplay area 120 is also selected, and thus the inspector displaysinformation about media clip 140. This information includes duration,file format, file location, frame rate, date created, audio informationetc. about the selected media clip. In some embodiments, differentinformation is displayed depending on the type of item selected.

The additional media display area 130 displays various types ofadditional media, such as video effects, transitions, still images,titles, audio effects, standard audio clips, etc. In some embodiments,the set of effects is represented by a set of selectable UI items, eachselectable item representing a particular effect. In some embodiments,each selectable UI item also includes a thumbnail age with theparticular effect applied. The display area 130 is currently displayinga set of effects for the user to apply to a clip. In this example, onlytwo effects are shown in the display area (the keyer effect and the lumakeyer effect, because the user has typed the word “keyer” into a searchbox for the effects display area).

The toolbar 135 includes various selectable items for editing, modifyingwhat is displayed in one or more display areas, etc. The right side ofthe toolbar includes various selectable items for modifying what type ofmedia is displayed in the additional media display area 130. Theillustrated toolbar 135 includes items for video effects, visualtransitions between media clips, photos, titles, generators andbackgrounds, etc. In addition, the toolbar 135 includes an inspectorselectable item that causes the display of the inspector display area125 as well as items for applying a reaming operation to a portion ofthe timeline, adjusting color, trimming, anchoring, creating positionclips, and other functions.

The left side of the toolbar 135 includes selectable items for mediamanagement and editing. Selectable items are provided for adding clipsfrom the clip browser 110 to the timeline 115. In some embodiments,different selectable items may be used to add a clip to the end of thespine, add a clip at a selected point in the spine (e.g., at thelocation of a playhead), add an anchored clip at the selected point,perform various trim operations on the media clips in the timeline, etc.The media management tools of some embodiments allow a user to markselected clips as favorites, among other options.

One or ordinary skill will also recognize that the set of display areasshown in the GUI 100 is one of many possible configurations for the GUIof some embodiments. For instance, in some embodiments, the presence orabsence of many of the display areas can be toggled through the GUI(e.g., the inspector display area 125, additional media display area130, and clip library 105). In addition, some embodiments allow the userto modify the size of the various display areas within the UI. Forinstance, when the display area 130 is removed, the timeline 115 canincrease in size to include that area. Similarly, the preview displayarea 120 increases in size when the inspector display area 125 isremoved.

B. Volume Control

FIG. 2 illustrates an example of modifying the audio content of a mediaclip that includes both audio and video contents in a timeline of amedia-editing application. Specifically, this figure illustrates atimeline 200 in eight different stages 205-240 to show changing volumelevel of the audio of a media clip 250 displayed in the timeline 200.FIG. 2 illustrates a media clip 245 and the media clip 250 displayed inthe timeline 200. The timeline 200 is similar to the timeline 115described, above by reference to FIG. 1 .

The media-editing application of some embodiments provides a volumecontrol for a user of the application to control the volume of a mediaclip displayed in the timeline 200. The audio portion of a media clipdisplayed in the timeline 200 includes a volume control. The volumecontrol in some embodiments appears as a horizontal line across thewaveform in the audio portion as shown in the stage 215 of this figure.As the user drags the line upwards or downwards, the media-editingapplication changes the volume of the audio content of the media clip.

The media-editing application also allows the user to select a range ofmedia clips displayed in the timeline 200 such that the user canselectively control the volume of the selected range. The audio portionin some embodiments includes fade handles 221 and 222, which appear nearboth ends of the waveform in the selected range as shown in the stage225 of this figure. The user can control fading of the audio content bydragging the handles along the volume control line.

In some embodiments, the media-editing application provides a set ofvolume patterns for the user to select. By choosing a pattern anddragging volume control knobs 254 and 255 (shown in the stages 235 and240), the user can apply the selected volume pattern to the audiocontent of the media clip. The volume control knob also moves along thevolume level control line. Using the volume control knob 254, the usercan apply a selected pattern from the beginning of a clip. The volumecontrol knob 255 allows the user to apply a selected pattern from theend of a clip.

In the first stage 205, the timeline 200 displays a media clip 250,which includes both audio and media contents. Accordingly, the mediaclip 250 includes an audio portion 252 and a video portion 251 in itsrepresentation in the timeline 200. In the second stage 210, thetimeline 200 highlights a volume control line 253 when the user selectsthe line 253 by a click operation.

In the third stage 215 the user drags the volume control line 253upwards in order to increase the volume of the audio content of themedia clip 250. In the fourth stage 220, the user selects (e.g., by aclick operation) a range of the media clip 250. In the fifth stage 225,the user brings down a portion of the volume control line 253 that fallswithin the selected portion. As a result, the volume is leveled down forthe duration of the media clip represented by the selected portion.

In the sixth stage 230, the timeline 200 displays a menu 231 for volumepatterns when the user selects a volume control knob (behind the menu231) by a click operation. The user can then select a volume patternfrom the menu 231. In this example, the user selects “Linear.” in theseventh stage 235, the timeline 200 applies the selected volume patternas the user drags the control knob 254 to the right. In the eighth stage240, the timeline 200 shows the selected pattern more apparently as theuser drags the control knob 254 to the right end of the media clip 250.

C. Multiple Playheads

FIG. 3 illustrates a timeline of a media-editing application having twoplayheads. Specifically, this figure illustrates a GUI 300 in twodifferent stages 305 and 310 to show that a timeline 315 includes twoplayheads for editing and playing back a media presentation. The GUI 300includes the timeline 315 and a viewer 320. The timeline 315 and theviewer 320 are similar to the timeline 115 and the viewer 120 describedabove by reference to FIG. 1 .

The timeline 315 of some embodiments provides two playheads, a skimmingplayhead 330 and a primary playhead 325. A playhead in some embodimentsappears as a vertical line in the timeline 315. A video frame of themedia presentation that the playhead is positioned at is displayed inthe viewer 320. A portion of audio content that corresponds to the framewill also be output to an audio output device by the media-editingapplication. The skimming playhead 330 is a playhead that matches theposition of the cursor in the timeline 315. The primary playhead 325 isa static playhead that scrolls across the timeline 315 during playbackor can be selected and moved across the timeline by the user of themedia-editing application. The primary playhead specifies a currentediting position in the timeline 315, while the skimming playheadspecifies a skimming position in the timeline 315.

When the cursor (not shown) enters the timeline 315, the skimmingplayhead appears and becomes the editing position, since it is the pointof focus. It will override the primary playhead 325 when it is presentin the timeline 315. When the cursor leaves the timeline and entersanother portion of the GUI 300, the primary playhead 325 is the currentediting position. The primary playhead 325 allows the user to leave thetimeline without losing the video frame of interest. As will bedescribed further below, the primary playhead 325 also allows the userto use hotkey edits to add, remove or modify the content of the mediapresentation at the position of the primary playhead. Also, when themedia presentation is previewed (i.e., when the media presentation isplayed back instead of being skimmed), the two playheads synch up andmove together horizontally along the timeline 315 in some embodiments.Also, in some embodiments, different colors are used to represent thedifferent playheads. For instance, a red color is used for the skimmingplayhead 330 and a gray color is used for the primary playhead 325 insome such embodiments.

In the first stage 305, the primary playhead 325 is placed at a positionof the timeline 315 so that the playhead intersects with the media clip335. In some embodiments, each point along the length of a media cliprepresents a video frame of the media clip. As shown, the media-editingapplication displays in the viewer 320 a frame of the media clip 335represented by a point along the timeline 315 at which the primaryplayhead 325 is positioned currently.

In the second stage 310, the skimming playhead 330 appears as a cursor331 enters into the timeline 315. The skimming playhead 330 is placed ata position of the timeline 315 such that the playhead intersects withthe media clip 340. As shown, the media-editing application displays inthe viewer 320 a frame of the media clip 340 represented by a pointalong the timeline 315 at which the skimming playhead 330 is positionedcurrently in some embodiments. When the cursor leaves the timeline 315,the skimming playhead 330 will disappear from the timeline 315 and theviewer 320 will display the video frame that it displayed in the firststage 305 because the primary playhead 325 has not been moved to anotherposition in the timeline 315.

II. Live Drag

A. Inserting a Media Clip

FIG. 4 illustrates an example of inserting a media clip between twoadjacent media clips in a timeline 401 of a media-editing application.Specifically, this figure illustrates a GUI 400 in four different stages405-420 that the media-editing application allows the user to add amedia clip 425 to the timeline 401 by inserting it between two mediaclips 430 and 435 displayed the timeline 401. The GUI 400 is similar tothe GUI 100 described above by reference to FIG. 1 in that the GUI 400includes a clip browser 445 and the timeline 401 which are similar tothe clip browser 110 and the timeline 115, respectively. The timeline401 includes a central compositing lane 440.

Some embodiments allow a user of the media-editing application to inserta media clip between two adjacent media clips within the timeline 401.The two adjacent media clips may be anchored clips or clips in thecentral compositing lane 440. Different embodiments provide differentways to insert a media clip between the two adjacent media clips. Someembodiments allow the user to drag a media clip from the clip browser445 or another media clip in the timeline 401 into the border betweenthe two media clips. The media-editing application of some embodimentsallow to add a selected media clip from the clip browser 445 between thetwo media clips as a playhead is passing close to the border between thetwo media clips.

Some embodiments shift the media clips (i.e., ripple the media clips inthe timeline) away from a particular point along the timeline 401between the two media clips as a media clip is being inserted to thepoint. In other embodiments, the media-editing application does notripple the media clips in the timeline when a media clip is dragged intothe particular point in the timeline. These embodiments overwrite anyclips or portions of clips with the clip being added for the duration ofthe clip being added starting at the particular point along thetimeline.

As shown, the created space for the media clip 425 is indicated by thehighlighted boundary 490 in this example. In some embodiments, themedia-editing application performs this movement in an animated motion,thereby creating an animated effect of the sliding of the clips in thetimeline away from the point of insertion to make room for the insertedclip(s).

In the first stage 405, the timeline 401 displays media clips 430 and435 in the central compositing lane 440. In the second stage 410, theuser selects (e.g., by a click operation, etc.) a media clip 425displayed in the clip browser 445 to bring into the timeline 401. In thethird stage 415, the user drag the selected media clip and hovers overthe two media clips 430 and 435 in between of which the user wants toinsert the media clip 425. The media clip 435 moves away from theparticular point 485 in between the two media clips 430 and 445 to makeroom for the media clip 425.

The fourth stage 420 illustrates the completion of the insertion of themedia clip 425 into the particular point 485 of the timeline 401. Insome embodiments, the media-editing application snaps the media clip 425into the space 490 that was created for the media clip 480 in the thirdstage 415.

B. Appending a Media Clip

FIG. 5 illustrates an example of appending a media clip to another mediaclip displayed in the timeline 401. Specifically, this figureillustrates the GUI 400 in three different stages 505-515 to show thatthe media-editing application allows the user of the application toappend a media clip 520 to the end of the sequence of media clips 525and 535 in the timeline 401.

Some embodiments allow a user of the media-editing application to appenda first media clip to a second media clip in the timeline 401. Thesecond media may be an anchored clip or a clip in the centralcompositing lane 440. Different embodiments provide different ways toappend a media clip after another media clip. Some embodiments allow theuser to drag a media clip from the clip browser 445 or another mediaclip in the timeline 401 to a right-edge of another media clip whichdoes not have a media clip appended to the right edge. The media-editingapplication of some embodiments allow to append a selected media clipfrom the clip browser 445 to the right edge of another media clip as aplayhead is passing close to the right edge. Yet other embodiments allowthe user to append a selected media clip from the clip browser 445 afterthe last media clip in the central compositing lane 440 by invoking ahot key command.

In the first stage 505, the timeline 401 displays media clips 525 and535 in the central compositing lane 440. As shown, the media clip 535 isthe last media clip of the sequence of the two media clips. In thesecond stage 510, the user selects a range of a media clip 520 (e.g.,selected via a cursor controller operation, selected from a keystroke,etc.) from the clip browser 545 towards the right edge of the media clip535. The third stage 515 illustrates the completion of appending themedia clip 520 to the media clip 535. The selected range of the mediaclip 520 appears at the end of the sequence in the timeline 401. In someembodiments, the media-editing application snaps the media clip 520 tothe right edge of the media clip 535.

C. Deleting a Media Clip

FIG. 6 illustrates an example of deleting a selected range of a mediaclip displayed in a timeline 600 of a media-editing application.Specifically, this figure illustrates the timeline 600 in threedifferent stages 605-615 to show the deletion of a range of a media clipthat is less than the whole media clip displayed in the timeline 600. Asshown, the central compositing lane 645 displays a compositepresentation of media clips that includes media clips 625-635.

The media-editing application in some embodiments allows a user todelete a portion of the sequence of media clips in the timeline 600. Insome embodiments, the user may select a full clip or multiple clips.Some embodiments allow the user to select a range that spans severalclips. The media-editing application of some embodiments may also allowthe user to select clips in the anchor lanes (rather than just the clipsin the central compositing lane).

The first stage 605 shows the timeline 600 including clips 625-635before the user performs a deletion operation. The second stage 610illustrates a selection of a particular portion 640 of the timeline 600(e.g., through a cursor controller operation, through a keyboardselection of the starting and ending point, through defining a startingpoint and a range). In this example, the selected particular portion 640is a portion of the media clip 630 (e.g., two and a half frames withinmedia clip 630).

The third stage 615 illustrates the deletion of the selected particularportion 640 from the timeline 600. The user of the media-editingapplication may invoke a command to delete the selected portion 640 byperforming keyboard operations (e.g., delete key), by selecting from adrop-down menu, by performing a cursor controller operation, etc. Uponthe deletion of the selected portion 640, the media-editing applicationdeletes the selected portion 640. As a result, the central compositinglane 645 no longer displays the selected portion 640. The media clip635, which comes after the deleted portion, ripples (i.e., moves to theleft on the central compositing lane 645) in order not to leave a gap inthe central compositing lane 645.

As illustrated by this example, the removal of the selected portion 640shortens the total duration of the timeline 600 by the duration of thedelete portion 640. The media-editing application in some embodimentsmaintains the total duration of the timeline by replacing the selectedportion with placeholder gaps in order to prevent ripple edits. Whilethis example illustrates the removal of a media clip within the centralcompositing lane, the media-editing application may also allow the userto delete an anchored clip.

D. Anchoring a Media Clip

FIG. 7 illustrates an example of anchoring a media clip to another mediaclip displayed in a timeline of a media-editing application.Specifically, this figure illustrates a GUI 700 in two different stages705 and 710 to show the media-editing application allows a user of theapplication to select a media clip from a clip browser and anchor theclip to another clip in the timeline 725. The GUI 700 is similar to theGUI 100 described above by reference to FIG. 1 in that the GUI 700includes a clip browser 715, a preview display area 720, and a timeline725 which are similar to the clip browser 110, the preview display area120, and the timeline 115, respectively.

Some embodiments allow the user to anchor a media clip to another mediaclip in the timeline 725 by selecting a single media clip or a range ofmedia clip from the clip browser and drag it above or below a media clipin the timeline 725. As described above, the media-editing applicationanchors a media clip only to a media clip in the central compositinglane 730. In other embodiments, the media clip that is anchored to maybe any clip displayed in any lanes in the timeline 725. That is, themedia-editing application of these embodiments allows the user to anchora media clip to a media clip that is in the central compositing lane 730or to a media clip that is anchored to another media clip.

In the first stage 705, a media clip 750 has been selected from the clipbrowser 715. The selection is received through a user selection input755 such as input received from a cursor controller (e.g., a mouse,touchpad, trackpad, etc.), from a touchscreen (e.g., a user touching aUI item on a touchscreen), etc.

In the second stage 710, a user has dragged the media clip 750 from theclip browser 715 and dropped it (by releasing the mouse button, “tap” ofa touchscreen, etc.) in the anchor lane 740 above the centralcompositing lane 730 and before the anchored media clip 760 in thetimeline 725. The media-editing application anchors the media clip 750to the media clip 765.

FIG. 8 illustrates another example of anchoring a media clip to anothermedia clip displayed in a timeline of a media-editing application.Specifically, this figure illustrates a GUI 800 in three differentstages 810, 815, and 820 to show that the media-editing applicationallows a user of the application to select a range of a media clip froma clip browser and anchor the selected range to several media clips as aprimary playhead passes by those several media clips. The GUI 800 issimilar to the GUI 100 described above by reference to FIG. 1 in thatthe GUI 800 includes a clip browser 825, and a timeline 830 which aresimilar to the clip browser 110 and the timeline 115, respectively. Thetimeline 830 includes a playhead 845, which is similar to the primaryplayhead 325 described above by reference to FIG. 3 .

In some embodiments, the media-editing application allows the user ofthe application to anchor a first media clip to a second media clip inthe timeline 830 based on the position of the playhead 845 along thetimeline 830. In some such embodiments, the media-editing applicationanchors the first media clip to the second media clip when the userinvokes a command to anchor as the playhead 845 passes by a positionalong the length of the second media clip. In some embodiments, thesecond media clip must be a media clip in the central compositing lane835. In other embodiments, the second media clip can be any media clipplaced in any lane of the timeline 830. The media-editing application inthese embodiments anchors a first media clip to a second media clip thatdoes not have above it another anchored clip that intersects theplayhead 845 at the moment the command to anchor is invoked. That is,these embodiments anchors the first media clip to the second media clipthat is in the uppermost lane of the timeline 830 among the media clipsthat the playhead is intersecting at the moment.

In the first stage 805, the timeline 830 displays media clips 831-833.The second stage 805 illustrates a selection of a range in a media clip850 from the clip browser 825 (e.g., by clicking a mouse button, tappinga touchpad, or touching a touchscreen). The media-editing applicationindicates the selection by a bolding of the border of that particularportion of the media clip 850. In this example, the user selects a rangeof the media clip 850 to anchor to a media clip displayed in thetimeline 830.

In the third stage 815, the user invokes a command provided by themedia-editing application to anchor the selected range to a media clipdisplayed in the central composing lane 835. At the moment when thecommand was invoked, the playhead 845 is placed at a position along thetimeline that intersects with the media clip 831. As a result, themedia-editing application places the media clip 855 (the selected rangeof the media clip 850) to that position along the timeline and anchorsthe media clip 855 to the media clip 831 at that position. The in-pointof the anchored media clip 855 coincides with the location of theplayhead 845. In some embodiments, the media-editing application placesan anchor 860 at the in-point of the anchored clip 855. Themedia-editing application places the anchor 860 that connects theanchored clip and the clip that is anchored at the in-point of theanchored clip 855.

In the fourth stage 820, the playhead 845 has continued to move alongthe timeline to the right as the media-editing application plays backthe media clips in the central compositing lane 835. The user invokesthe command to anchor again when the playhead is intersecting the mediaclip 832. The media-editing application anchors the selected range ofthe media clip 850 as a media clip to the media clip 832 at the positionof the playhead 840. In this manner, the media-editing applicationcreated duplicate copies of the selected range of the media clip 850 andanchored the copies to different media clips in the central compositinglane 835.

FIG. 9 illustrates yet another example of anchoring a media clip toanother media clip displayed in a timeline of a media-editingapplication. Specifically, this figure illustrates a timeline 900 inthree different stages 905-915 to show that the media-editingapplication allows a user of the application to remove a media clip froma central compositing lane 920 and anchor it to another media clip inthe central composing lane 920. The timeline 900 is similar to thetimeline 115 described above by reference to FIG. 1 .

The media-editing application of some embodiments allows the user toremove a media clip from the central compositing lane 920 and anchor itto another media clip in the timeline 900. In some embodiments, themedia-editing application allows the user to drag a first media clip outof the central compositing lane 920 and drop it above or below a secondmedia clip to anchor the first media clip to the second media clip. Thesecond media clip may be any media clip in any lane of the timeline 900.

In the first stage 905, the timeline 900 displays media clips 930-945 inthe central compositing lane 920. In the second stage 920, the userselects the media clip 935 (e.g, by a click operation) and starts todrag it out of the central compositing lane 920.

In the third stage 915, the user drops the media clip 935 at a locationabove the media clip 930 in the timeline 900. The media-editingapplication anchors the media clip 935 to the media clip 930 in theanchor lane 925 such that the anchor 950 points to a particular pointalong the length of the media clip 930.

E. Moving an Anchored Clip into Central Compositing Lane

FIG. 10 illustrates an example of moving an anchored media clip into acentral compositing lane in a timeline of a media-editing application.Specifically, this figure illustrates a timeline 1000 in four differentstages 1005, 1010, 1015, and 1020 to show that the media-editingapplication allows a user of the application to move an anchored clip1025 from an anchor lane 1030 and place it between clips 1035 and 1040that are displayed in a central compositing lane 1045. The timeline 1000is similar to the timeline 115 described above by reference to FIG. 1 .

In some embodiments, the media-editing application allows the user toadd an anchored clip into the central compositing lane. Some embodimentsallow it by inserting an anchored clip between two adjacent clips orappending the anchored clip after the last media clip displayed in thecentral compositing lane. Also, some embodiments allow the user toreplace a media clip or a selected range over one or more media clips inthe central compositing lane with an anchored clip.

At stage 1005, the user selects the anchored clip 1025 has been selectedfrom the anchor lane 1030 (e.g., by clicking a mouse button, tapping atouchpad, or touching a touchscreen). At stage 1010, the user hasdragged the anchored media clip 1025 from its previous location andhovers the media clip (without dropping it) over media clips 1035 and1040 displayed on central compositing lane 1045 such that the leftborder line (in-point) of the media clip 1025 has covered a portion ofthe media clip 1040.

At stage 1015, the user has dragged the anchored media clip 1025 furthertowards left in such a way that the left edge (in-point) of the mediaclip has covered a portion of media clip 1035 as shown in this stage. Inother words, the user has hovered media clip 1025 between the two mediaclips 1035 and 1040 in the central compositing lane 1045. As a result,the media-editing application makes space between the two media clips1035 and 1040 in the central compositing lane 1045 for the anchoredmedia clip 1025.

At stage 1020, the user has dropped the anchored media clip 1025 (byreleasing the mouse button, “tap” of a touchscreen, etc.) in the spacepreviously created at stage 1015. Consequently, the media-editingapplication places the media clip 1025 between the two media clips 1035and 1040 in the central compositing lane 1045.

F. Moving Anchored Clips Along Anchor Lanes

FIG. 11 illustrates an example of moving an anchored clip along ananchor lane in a timeline of a media-editing application. Specifically,this figure illustrates the GUI 1100 in three different stages 1105,1110, and 1115 to show that a preview display area 1185 displays theframe of a media clip to which an media clip 1130 is anchored. The GUI1100 is similar to the GUI 100 described above by reference to FIG. 1 inthat the GUI 1100 includes a timeline 1180 and the preview display area1185 which are similar to the clip browser 110 and the timeline 105,respectively.

In some embodiments, an anchored media clip is represented as arectangular shape. Each anchored media clip also has an anchor, which isrepresented as a pointer attached to the rectangular shape that connectsthe rectangular shape and a media clip representation displayed in thecentral compositing lane of a timeline. When a first media clip isanchored to a second media clip that is displayed in the centralcompositing lane, the anchor of the first media clip points to aposition along the length of the second media clip. In some embodiments,the media-editing application displays a frame of the media cliprepresented by that position in the preview display area, when the firstmedia clip is selected.

The operation of the GUI 1100 will now be described by reference to thethree stages 1105-1115 that are illustrated in FIG. 11 . In the firststage 1105, the media-editing application displays two media clips 1170and 1165 in the central compositing lane 1140 and two anchored mediaclips 1130 and 1135. The first anchored media clip 1130 is anchored tothe media clip 1165 in the central compositing lane 1140. The previewdisplay area 1185 does not display any frame as no media clip isselected and a playhead is intersecting none of the media clips.

The second stage 1110 illustrates that the user has selected the firstanchored media clip 1130 in the anchor lane 1125 using a cursor (e.g.,by clicking a mouse button, tapping a touchpad, or touching atouchscreen). The media-editing application indicates the selection byhighlighting the border of the anchored media clip 1130 as shown. Theuser selects the anchored media clip 1130 as the media clip that theuser wishes to move along the anchor lane. As shown, the preview displayarea 1185 displays the frame in the media clip 1165 to which the anchorof the media clip 1130 is pointing.

At stage 1115, the user has dragged the anchored media clip 1130 towardsright and dropped it (by releasing the mouse button, “tap” of atouchscreen, etc.) closer to the anchored media clip 1135. As shown instage 1115, the position of the anchor of the anchored audio clip 1130does not change by changing the position of the anchored clip. In otherwords, the anchor and the anchored clip will move along the anchor lanetogether and as one entity. Moreover, the preview display area 1185 isnow displays a frame of the media clip 1165 to which the anchor 1175 ispointing.

FIG. 12 illustrates an example of moving multiple anchored clips alongan anchor lane in a timeline of a media-editing application.Specifically, this figure illustrates the timeline 1200 in fourdifferent stages 1205, 1210, 1215, and 1220 to show that themedia-editing application allows a user of the application to movemultiple anchored clips along different anchor lanes. The timeline 1200is similar to the timeline 115 described above by reference to FIG. 1 .The timeline 1200 includes a central compositing lane 1235.

Some embodiments allow the user of the application to select two or moreclips in different anchor lanes of the timeline 1200 to move together.This allows preserving the timing information between the selectedanchored clips when the clips are placed in different positions alongthe timeline 1200.

The operation of the timeline 1200 will now be described by reference tothe four stages 1205-1220 that are illustrated in FIG. 12 . In the firststage 1205, the media-editing application displays two media clips 1250and 1255 in the central compositing lane 1235. In addition, themedia-editing application displays a media clip 1240 is in the anchorlane 1225 above the central compositing lane 1235 and a media clip 1245is in the anchor lane 1230 below the central compositing lane 1235. Themedia clips 1240 and 1245 are anchored to the media clip 1250 in thecentral compositing lane 1235.

The second stage 1210, illustrates that a user has selected the anchoredmedia clip 1245 in the anchor lane 1230 by using a cursor (e.g., byclicking a mouse button, tapping a touchpad, or touching a touchscreen).The selection is illustrated in some embodiments by a bolding of theborder of the anchored media clip 1245. The user selects the anchoredmedia clip 1245 as one of the media clips that the user wishes to movealong the anchor lanes.

The third stage 1215, illustrates that the user has selected theanchored media clip 1240 in the anchor lane 1225 as the second selectedanchored media clip by using a cursor (e.g., by clicking a mouse button,tapping a touchpad, or touching a touchscreen). The selection isillustrated by a bolding of the border of the anchored media clip 1240.The user selects the anchored media clip 1240 as the second media clipthat the user wishes to move along the anchor lanes.

At stage 1220, the user has dragged the anchored media clips 1240 and1245 towards the right and dropped them (by releasing the mouse button,“tap” of a touchscreen, etc.) close to the end of the second media clipin the central compositing lane 1235. As a result, the media clips 1240and 1245 are anchored to the media clip 1255 in the central compostinglane 1235. The relative positions of the two anchored media clips arenot changed.

As illustrated, the user moves two anchored media clips along twodifferent anchor lanes at the same time in this example. However, theuser may move any number of anchored media clips (or portions ofanchored clips) from multiple anchor lanes above the central compositinglane and multiple anchor lanes below the central compositing lane at thesame time as well. As described above, the user may also move one ormore anchored media clips from one position in the anchor lane toanother position in the same anchor lane.

C. Duplicating Anchor Clips

FIG. 13 illustrates an example of duplicating anchored clips in anchorlanes of a timeline of a media-editing application. Specifically, thisfigure illustrates the timeline 1300 in four different stages 1305,1310, 1315, and 1320 to show that the media-editing application allows auser of the application to copy one or more anchored clips from aposition in anchor lanes and paste them in a different position in theanchor lanes. The timeline 1300 is similar to the timeline 115 describedabove by reference to FIG. 1 .

Some embodiments allow the user to create duplicate copies of one ormore media clips displayed in the timeline 1300 and place the duplicatecopies of the clips in another location within the timeline 1300. Themedia-editing application preserves relative timing information betweentwo or more anchored media clips when the duplicate copies of them areplaced in another location within the timeline.

The operation of the timeline 1300 will now be described by reference tothe four stages 1305-1320 that are illustrated in FIG. 13 . In the firststage 1305, the media-editing application displays two media clips 1355and 1360 in the central compositing lane 1335. The media-editingapplication also displays a media clip 1340 in the anchor lane 1325above the central compositing lane 1335 and a media clip 1345 in theanchor lane 1330 below the central compositing lane. The media clips1340 and 1345 are anchored to the media clip 1250 in the centralcompositing lane 1335.

The second stage 1310 illustrates that a user has selected and copiedthe anchored media clips 1340 and 1345 in the anchor lanes 1325 and1330, respectively. More detail of selecting a media clip is describedabove by reference to FIG. 12 . The selection is illustrated in someembodiments by a bolding of the border of the anchored media clips 1340and 1345. In this example, the user selects the anchored media clips1340 and 1345 as the two media clips that the user wishes to pasteduplicate copies of them somewhere else in the anchor lanes. As it ismentioned above, the user has also copied these two clips at this stage.In order to copy an anchored clip, some embodiments provide a pop-up orpull-down menu or window (not shown) to receive a user input as to wherethe copy must be saved. In some such embodiments, a user also has theoption to save the copy of the anchored media clip in other temporarystorage (e.g., a clipboard).

The third stage 1315 illustrates that the user has selected a differentspot on the anchor lane by using a cursor (e.g., by clicking a mousebutton, tapping a touchpad, or touching, a touchscreen). In thisexample, the media-editing application allows the user to specify theposition along the timeline 1300 to which to paste the duplicate copiesof the media clips 1350 and 1345 by a skimming playhead 1351. Theskimming playhead is similar to the skimming playhead 330 describedabove by reference to FIG. 3 .

In the fourth stage 1320, the user has pasted the anchored media clips1340 and 1345 at locations in the timeline 1300 where the user hadpreviously specified in the third stage 1315. As shown in this stage1320, the two anchored media clips 1340 and 1345 are copied onto the newlocations in the anchor lanes with exactly the same relative positionsthey had in their original locations with respect to the centralcompositing lane 1335. In order to paste an anchored clip, someembodiments provide a pop-up or pull-down menu or window (not shown) toreceive a user input as to where the saved copy must be pasted. In someembodiments, the media-editing application also provides an option topaste the saved copy of the anchored media clip from the clipboard.

While the above example illustrates copying two anchored media clips intwo different anchor lanes at the same time and then pasting them at thesame time, some embodiments allows the user to copy and paste any numberof anchored media clips from the anchor lane above the centralcompositing lane and the anchor lane below the central compositing lane(not shown) at the same time as well. The user may also copy and paste(not shown) one or more anchored media clips from one position in theanchor lane to another position in the same anchor lane.

H. Snapping Media Clips

FIG. 14 illustrates an example of horizontal snapping of two media clipsdisplayed in a timeline of a media-editing application. Specifically,this figure illustrates the timeline 1400 in three different stages1405, 1410, and 1415 to show that the media-editing application snaps amedia clip 1435 to a media clip 1430 as the user moves the media clip1435 within a certain distance from the media clip 1430. The timeline1400 is similar to the timeline 115 described above by reference to FIG.1 .

In some embodiments, the media-editing application snaps a first mediaclip to a second media clip when the user drags (e.g., by a cursoroperation) the first media clip close to the second media clip fromeither side of the second media clip. When the user moves the firstmedia clip from the right side of the second media clip, themedia-editing application snaps the left edge of the first media clip tothe right edge of the second media clip. Conversely, when the user movesthe first media clip from the left side of the second media clip, themedia-editing application snaps the right edge of the first media clipto the left edge of the media clip. The media-editing applicationapplies this snapping feature to any types of clips in any lanes(central compositing lanes, anchor lanes, etc.) that may be displayed inthe timeline.

As will be described further below, some embodiments may move away thesecond clip to make room for the first media clip. Also, someembodiments may temporarily superimpose the second clip to prompt forreplacement options. Therefore, the media-editing application of someembodiments uses a set of criteria to determine an operation to perform.The set of criteria may include the velocity of the first media clip atwhich the second media clip is moving to the, types of clips the firstand second clips are, the direction in which the first media clip isapproaching the second media clip, the origin (e.g., a clip browser, atimeline, etc.) from which the first media clip is moving, etc.

The operation of the timeline 1400 will now be described by reference tothe three stages 1405-1415 that are illustrated in FIG. 14 . In thefirst stage 1405, the media-editing application displays two anchoredmedia clips 1430 and 1435 in two different positions in the anchor lane1420. The user has selected the anchored media clip 1435. In someembodiments, the user of the media-editing application may perform thisselection by clicking a mouse button, tapping a touchpad, or touching atouchscreen. The selection is shown in some embodiments by a bolding ofthe border of the anchored media clip 1435. The user selects the mediaclip 1435 to move it towards the media clip 1430 in the anchor lane1420.

The second stage 1410 illustrates that the user has dragged the anchoredmedia clip 1435 towards the left and close to the media clip 1430. Whenthe distance between two media clips drops below a certain thresholddistance, the media-editing application determines an operation toperform based on a set of criteria.

At stage 1415, the user has released the anchored media clip 1435 (byreleasing the mouse button, “tap” of a touchscreen, etc.) when thedistance between the two clips (e.g., the distance between the upperright corner of the media clip 1430 and the upper left corner of themedia clip 1435) is smaller than a certain distance. Using the set ofcriteria, the media-editing application determines that the operation toperform is snapping the two media clips and then snaps the media clip1435 to the right edge of the media clip 1430. As a result, the twomedia clips become two contagious clips as shown.

I. Vertically Swapping Anchored Clips

FIG. 15 illustrates an example of vertical swapping of two anchoredmedia clips in two different anchor lanes in a timeline of amedia-editing application. Specifically, this figure illustrates atimeline 1500 in three different stages to show that the media-editingapplication allows a user of the application to vertically swap ananchored clip 1550 with an anchored clip 1545. The timeline 1500 issimilar to the timeline 105 described above by reference to FIG. 1 .

As described above, an anchored clip's media content is composited with(e.g., overlay, superimpose, mix, etc.) the media content of the mediaclip in a compositing lane. When there are multiple anchored dips at aposition along the timeline 1500, the media content of an anchored clipin an upper anchor lane takes the priority over the media content of amedia clip in a lower lane in some embodiments. By allowing verticalswapping, the media-editing application provides a simple way ofchanging priorities of the anchored clips.

The operation of the timeline 1500 will now be described by reference tothe three stages 1505-1515 that are illustrated in FIG. 15 . In thefirst stage 1505, the media-editing application displays three anchoredmedia clips 1540-1550 in three different anchor lanes 1520-1530,respectively. The user has selected the anchored media clip 1550 in theanchor lane 1530 using a cursor (e.g., by clicking a mouse button,tapping a touchpad, or touching a touchscreen). The selection isillustrated in some embodiments by a bolding of the border of theanchored media clip 1550. The user has selected the anchored media clip1550 to swap with the anchored media clip 1545 in the anchor lane 1525.

The second stage 1510 illustrates that the user has dragged the anchoredmedia clip 1550 up and towards the anchored media clip 1545 in theanchor lane 1525. The media-editing application overlays the media clip1545 with the media dip 1550. Based on a set of criteria, themedia-editing application determines an operation to perform.

In the third stage 1515, the user has released the anchored media clip1550. Using, the set of criteria, the media-editing applicationdetermines that it will swap the two media clips vertically and theswaps the two media clips. Accordingly, the compositing priorities ofthe two media clips have been switched as well.

J. Live Drag

FIG. 16 illustrates a timeline 1600 of a media-editing application thatdisplays results of editing operations as the editing operations arebeing performed. Specifically, FIG. 16 illustrates the timeline 1600 infour different stages 1605-1620 to show that the timeline 1600 displaysmedia clip 1625 being pushed up to another anchor lane as media clip1625 is dragged towards the media clip 1630. The timeline 1600 issimilar to the timeline 115 described above by reference to FIG. 1 .

As described above, the media-editing application of some embodimentsallows the user to edit a media presentation by moving a media clip fromone location to another location within a timeline or from an area outof the timeline into the timeline. For instance, the user can drag amedia clip from a clip browser (not shown) into a central compositinglane or to a location occupied by an anchored clip in an anchor lane.Some embodiments show the result of editing operation performed bymoving media clips as the operations are being performed. In otherwords, when the user moves media clips within the timeline or into thetimeline, the timeline of these embodiments display movement of themedia clips.

When a media clip is dragged into the central compositing lane andcollides with the media clips displayed in the lane, the media clips inthe central composting lane move along the central compositing lane,whereas anchored clips may also get pushed up or down. The up or downmovement of the anchored clips in some embodiments can be viewed asdynamic creation of anchor lanes. For instance, when an anchored clipcollides with a media clip that is being dragged, the anchored mediaclip moves to a higher level to make space for the dragged clip.

In some embodiments, the media-editing application displays a visualindication between the media clips as a media clip is dragged and movedover the region of the timeline 1600. This visual indication helps theuser to identify the media clips between which the user may wish toplace the media clip being dragged.

In the first stage 1605, the timeline 1600 displays the media clips 1625and 1630 in the anchor lane 1640. These two clips are anchored off themedia clips displayed in the central compositing lane 1635. In thesecond stage 1610, the user selects (e.g., via a clicking operation) theanchored media clip 1630 to drag it to the left.

In the third stage 1615, the user drags the media clip 1630 to alocation close to the media clip 1625. As the media clip 1630 is draggednear the media clip 1625, the timeline 1600 moves the media clip 1625upward so as to make room for the media clip 1630. In the fourth stage,the user drags the media clip 1630 to a location that was formerlyoccupied by the media clip 1625. The timeline 1600 moves the media clip1625 above the media clip 1630. As a result, timeline 1600 has createdanother anchor lane 1650 on top of the anchor lane 1640.

FIG. 17 conceptually illustrates a process 1700 of some embodiments forrearranging positions of media clips in a timeline while a media clip isbeing dragged over or extended into different regions of the timeline.The process 1700 is performed by a media-editing application. Theprocess starts when the media-editing application displays a timeline.

The process begins by determining (at 1705) whether a media clip isselected for editing. As described above, a selection of a media clipfor editing can be accomplished in a variety of ways. For instance, auser can select a media clip in a timeline by clicking on a portion ofthe media clip. In some embodiments, the process determines that a mediaclip is selected for editing when only part of a media clip is selected.For instance, the process determines that a media clip is selected forediting when either side edge of the media clip is selected for trimmingor extending. Also, the process determines that a media clip is selectedfor editing when a media clip is being brought from out of the timeline.For instance, a media clip that is being dragged into the timeline isdeemed selected by the process.

When the process determines (at 1705) that no media clip is selected forediting, the process loops back to 1705 until a selection is made.Otherwise, the process determines (at 1710) whether the selected mediaclip has moved within a threshold distance from a second media clip.Different embodiments determine whether the selected media clip hasmoved within the threshold distance differently. In some embodiments,the process draws an invisible shape around the second media clip. Theprocess in these embodiments determines that the selected media clip iswithin the threshold distance from the second media clip when any partof the selected media clip comes within the enclosing shape. In somecases, the selected media clip comes within the enclosing shape when thewhole media clip is selected and dragged. In other cases, the selectedmedia clip comes within the enclosing shape when the selected media clipis extended into the enclosing shape. The process in other embodimentsplaces invisible markers throughout a media clip's border and measuresthe distance between two media clips by measuring the shortest distancebetween any two markers (i.e., one for each media clip) of the two mediaclips.

When the process determines (at 1710) that the selected media clip iswithin a certain threshold distance from another media clip, the processproceeds to 1720 which will be described further below. Otherwise, theprocess determines (at 1715) whether the selected media clip isdeselected. The user may deselect a selected media clip in a variety ofdifferent ways. For instance, the user can deselect a selected mediaclip by releasing a mouse button or removing a finger from a touchscreen, etc.

When the process determines (at 1715) that the selected media clip hasnot been deselected, the process loops back to 1710 to determine theselected media clip has been moved within a threshold distance of asecond media clip. Otherwise, the process places (at 1725) the mediaclip at the location in the timeline where the media clip has beendeselected. In some cases, the location in the timeline where theprocess places the media clip may be the same location as the selectedmedia clip's initial location. The process then loops backs to 1705 todetermine whether there is a media clip selected for editing.

When the process determines (at 1710) that the selected media clip hasbeen moved within a threshold distance from the second media clipdisplayed in the timeline, the process determines (at 1720) whether theselected media clip has been within the threshold distance from thesecond media clip for longer than a certain threshold period of time. Insome embodiments, the process uses different threshold value fordifferent cases. For instance, the process may use different thresholdperiod for cases when the selected media clip is touching or at leastpartly overlapping the second media clip and for cases when the selectedmedia clip is not in contact with another media clip.

When the process determines (at 1720) that the selected media clip hasbeen within the threshold distance from the second media clip longerthan the threshold period of time, the process proceeds to 1735 whichwill be described further below. Otherwise, the process determines (at1740) whether the selected media clip has been deselected. When theprocess determines (at 1740) that the media clip has been deselected,the process places (at 1745) at the location where the selected mediaclip was deselected. The process also identifies all other media clipsaffected by the placement of the selected media clip at the new locationof the selected media clip. The affected media clips may include thesecond media clip. The process changes the locations of those affectedmedia clips to new locations if necessary. For instance, the process maypush the second media clip up to another anchor lane. The affected mediaclips may include other media clips whose positions are affected by thebumped up media clip. In this manner, the placement of the selected (nowdeselected) media clip may cause a series of movements of some of themedia clips in the timeline.

When the process determines (at 1740) that the selected media clip hasnot been deselected, the process determines (at 1750) whether theselected media clip has moved away from the second media clip such thatthe selected media clip is no longer within the threshold distance formthe second media clip. When the process determines (at 1750) that theselected media clip has been moved away, the process loops back to (at1710) to determine whether the selected media clip has moved within athreshold distance from a third media clip.

When the process determines (at 1750) that the selected media clip hasnot been moved away from the second media clip further than thethreshold distance, the process loops back to 1720 to determine whetherthe selected media clip has been within the threshold distance from thesecond media clip longer than the threshold period of time.

When the process determines (at 1720) that the selected media clip hasbeen moved within the threshold distance from the second media clip andhas been there for longer than the threshold period of time, the process(at 1735) identifies the media clips that are affected by the movementof the selected media clip and displays the affected media files indifferent locations in the timeline if necessary. As described above,the process may move the second media clip to another location and themovement of the second media clip may affect other media clips that wereplaced near or adjacent to the second media clip. Placing affected mediaclips will be described in detail further below by reference to FIGS. 18and 19 .

Process 1700 then determines (at 1755) whether the selected media cliphas been deselected. When the process determines that the selected mediaclip has been deselected, the process places (at 1760) the selectedmedia clips and the affected media clips at the locations to which theprocess has moved (at 1735) them. Otherwise, the process determines (at1765) whether the selected media clip has moved away from the secondmedia clip such that the selected media clip is no longer within thethreshold distance from the second media clip.

When the process determines (at 1765) that the selected media clip hasnot been moved away from the second media clip, the process loops backto 1755 to determine whether the selected media clip is deselected.Otherwise, the process puts back the affected media clips back to thelocations where they had been before the process moved (at 1735). Theprocess puts (at 1770) them back because the selected media clip was notdeselected (i.e., not released) while it was within the thresholddistance from the second media clip. The process then loops back to 1710to determine whether the selected media clip has moved within athreshold distance of a third media clip.

One of ordinary skill in the art will recognize that process 1700 is aconceptual representation of the operations used to arrange the mediaclips in a timeline as one of media clip is being moved within atimeline. The specific operations of process 1700 may not be performedin the exact order shown and described. The specific operations may notbe performed in one continuous series of operations, and differentspecific operations may be performed in different embodiments.Furthermore, the process could be implemented using severalsub-processes, or as part of a larger macro process. For instance, theoperations the process 1700 performs are described in the context of oneselected media clip being moved around the timeline and coming close toone other media clip. However, the process may perform these operationsfor other combinations of media clips. For instance, the media clipbeing moved around in the timeline could be a combination of two or moremedia clips that are selected together. Also, such media clip may be aselected range over one or media clips.

FIG. 18 conceptually illustrates a process 1800 of some embodiments forplacing media clips in a timeline when a media clip has moved to a newposition in the timeline. The process 1800 is performed by amedia-editing application. In some embodiments, process 1800 isperformed whenever the media-editing application determines that amoving media clip has moved to a new location in the timeline or hasbeen in a location that is closer than a threshold distance from anothermedia clip for longer than a threshold period of time. Process 1800 willbe described by reference to FIG. 19 , which illustrates an example ofplacing media clips in a timeline 1900 in six different stages1905-1930. FIG. 19 illustrates media clips A, B, C, D, E and F. Themedia clips A, B, and C are in spine 1901. The media clip D is initiallyanchored to the media clip A and spans part of the media clips A and Bhorizontally. The media clip E is anchored to the media clip B and spanspart of the media clip B horizontally. The media clip F is a movingmedia clip. That is, the media clip F is being moved into a new locationin the timeline 1900. Process 1800 starts when a media clip has moved toa new location in the timeline or has been in a location in the timelinethat is closer than a threshold distance from another media clip forlonger than a threshold period of time.

Process 1800 begins by identifying (at 1805) media clips that areaffected by the moving clip. As described above, the affected clips arethose clips that the media-editing application moves as a result ofhaving moved the moving piece to its new location. As shown at stage1901 in FIG. 19 , the media clip F has moved to a new location such thatthe media clip F partially overlaps the media clip E in the timeline1900. Since the media-editing application of some embodiments does notallow two anchored clips to overlap each other within one anchor lane,the media-editing application moves the media clip E to another locationin the timeline 1900. As such, the media clip E is a media clip affectedby the movement of the media clip F. The media clip D is not affectedbecause it does not have to move. The height of the media clip D islarger than that of another media clip in the timeline 1900 because themedia clip D has its audio and video portion visually separated in thisexample.

Process 1800 then selects (at 1810) next bottom clip. A bottom clip is aclip among the affected clips and the moving clip to be placed closestto the spine of the timeline. In some embodiments, the process finds thebottom clip using the lane numbers of the lanes that the affected mediaclips are occupying before the moving clip has moved. Lane numbers aredescribed further below by reference to FIG. 33 . At stage 1905 in FIG.19 , the media-editing application identifies the media clip F as thebottom clip. This is because the media clip E will be moved to anotheranchor lane above the lane that the media clip E currently occupies. Asdescribed above, an anchored media clip retains its temporal positionrelative to a media clip in the spine to which the anchored clip isanchored. Thus, in order to retain that relative temporal position ofthe media clip E with respect to the media clip B and to avoidoverlapping the media clip E with the media clip F, the media-editingapplication of some embodiments moves the media clip E into anotheranchor lane. The media-editing application does not move the media clipE closer to the spine 1901 because the media clip D is already occupyingpart of the space below the media clip E.

Process 1800 then defines (at 1815) available spaces to place the bottomclip. In some embodiments, the process first defines all availablespaces based on the positions of the side edges of the affected mediaclips and the moving media clip. For instance, as shown at stage 1910 inFIG. 19 , the media-editing application defines rectangular space 1911(depicted as a dotted rectangle) bounded by the horizontal position ofthe left edge of the media clip E and the horizontal position of theright edge of the media clip D. The media-editing application definesrectangular space 1912 (depicted as a dotted rectangle) bounded by thehorizontal position of the right edge of the media clip D. At stage1915, the media-editing application divides the 1911 space 1911 into twospaces 1915 and 1916 based on the horizontal position of the left edgeof the media clip F. The media-editing application defines these spaces1911, 1912, 1915, and 1916 in order to find an anchor lane that isclosest to the spine 1901 and that can include the entire length of themedia clip F (i.e., the current bottom clip) without moving the mediaclip F horizontally.

Next, process 1800 finds (at 1820) a location in which to place thecurrent bottom clip and places the current bottom clip at the location.In some embodiments, the process finds lowest possible horizontal spanthat can include the entire width of the current bottom clip. Forinstance, as shown at stage 1915 in FIG. 19 , the space 1912 alonecannot contain the entire width of the media clip F horizontally.Together with the space 1916, the space 1912 can contain the entirewidth of the media clip F. As shown, the space 1916 is above the mediaclip D. Thus, the media-editing application places the media clip Fabove the media clip D.

Process 1800 then determines (at 1825) whether all clips that need to beplaced have been placed. That is, the process determines whether all ofthe affected clips as well as the moving clip have been placed in thetimeline. When the process determines (at 1825) that there are moreclips to place, the process loops back to 1810 to select the next bottomclip to place. Otherwise, the process ends. As shown at stage 1920 inFIG. 19 , the media editing application has not placed the media clip Eyet. The media-editing application defines the space 1915 and a space1921. The space 1921 is defined above the media clip F and bounded bythe both side edges of the media clip F.

At stage 1925 in FIG. 19 , the media-editing application divides thespace 1921 into spaces 1926 and 1927 based on the horizontal position ofthe right edge of the media clip E. As shown, the space 1915 alonecannot contain the entire width of the media clip E horizontally.Together with the space 1926, the space 1915 can contain the entirewidth of the media clip F. As shown, the space 1926 is above the mediaclip F. Thus, at stage 1930, the media-editing application places themedia clip E above the media clip F.

One of ordinary skill in the art will recognize that process 1800 is aconceptual representation of the operations used to arrange the mediaclips in a timeline as one of media clip is being moved within atimeline. The specific operations of process 1800 may not be performedin the exact order shown and described. The specific operations may notbe performed in one continuous series of operations, and differentspecific operations may be performed in different embodiments.Furthermore, the process could be implemented using severalsub-processes, or as part of a larger macro process.

III. Live Edit

FIG. 20 conceptually illustrates a GUI 2000 of a media-editingapplication that displays the results of editing operations in a viewer2020 as the editing operations are being performed. Specifically, FIG.29 illustrates the GUI 2000 in three different stages 2005-2015 as auser of the application moves an anchored clip 2025 along a timeline2030 such that it intersects with the playhead that is moving throughthe timeline. The GUI 2000 is similar to the GUI 100 described above byreference to FIG. 1 in that the GUI 2000 includes a clip browser 2040, aviewer 2020, and a timeline 2030 which are similar to the clip browser110, the timeline 115, and the viewer 110, respectively.

The media-editing application of some embodiments allows the user toedit a media presentation by moving a media clip from one location toanother location within a timeline or from an area out of the timelineinto the timeline. For instance, the user can drag a media clip from theclip browser 2040 into a central compositing lane 2045 or into an anchorlane. Some embodiments show the composite result of the editingoperation performed by moving media clips as the operations are beingperformed. More specifically, the media-editing application of someembodiments displays a composite image represented by a point along thetimeline 2030 in the viewer 2020 as the playhead 2035 moves to the pointthat intersects with a media clip that is being moved.

As the playhead 2035 moves along the timeline 2030 (i.e., as themedia-editing application playbacks the media presentation), themedia-editing application displays a composite frame of the mediapresentation represented by a point along the timeline 2030 at which theplayhead is positioned currently. When any part of a media clip occupiesa point along the timeline 2030 at the moment the playhead 2035 ispassing the point, the media-editing application will factor that mediaclip into the composite image displayed for that point. When a mediaclip is in an anchor lane above the central compositing lane, the outputimage will be that of the anchor lane (unless there is a blend operationdefined between the two frames).

In the first stage 2005, the timeline 2030 displays an anchored mediaclip 2025 and media clips 2026-2029 within the central compositing lane2045. At this point, the media-editing application is playing back themedia presentation and thus the playhead 2035 is moving to the rightthrough the timeline 2030. The playhead 2035 currently is in the middleof the media clip 2026, and thus the preview display area 2020 displaysan image of the media clip 2026 that corresponds to the portion of themedia clip at which the playhead is currently located.

In the second stage 2010, the user has selected the media clip 2025 andis dragging the media clip 2025 to the left such that the playhead thatis moving to the right intersects with the media clip 2025. Because theclip 2025 is in the anchor lane, the preview display area 2020 displaysthe image from this clip, rather than media clip 2028 in the centralcompositing lane. At this point, the playhead 2035 is continuing to moveto the right to play the presentation. In some embodiments, as soon asthe playhead intersects the left edge (in-point) of clip 2025, theplayback image displayed in the preview display area changes to that ofthe anchored clip 2025.

In the third stage 2015, the user is dragging the media clip 2025 to theright along with the playhead 2035. As in the stage 2010, themedia-editing application displays a frame from the media clip 2025 inthe preview display area 2020. This is a different frame than shown atstage 2010, as the playhead is located over a different portion of theclip 2025. In theory, a user could drag the anchored clip to the rightat the same rate as the playhead, and have the same image displayed inthe preview display area.

The media clip 2025, therefore, has been moved back and forth along thetimeline 2030 as shown in the stages 2010-2015. As the clip 2025 hasbeen moving back and forth, the primary playhead has intersected withdifferent parts of the clip 2025 at different points along the timeline2030. The media-editing application has been reflecting the compositeframes resulted from these intersections caused by the movement of themedia clip 2025.

FIG. 21 conceptually illustrates a process 2100 for incorporating editsinto playback of a video sequence in real-time. As shown, the process2100 begins by receiving (at 2105) a project playback command. In someembodiments, the user commands the media-editing application to playback the contents of the timeline. The playback may start at the currentlocation of the playhead in the timeline, or at the beginning of theproject (i.e., time=0).

The process moves (at 2110) the playhead in the timeline. Themedia-editing application displays the movement of the playhead at arate representative of real-time. That is, in a particular amount ofactual time, the playhead moves over a portion of the timelinerepresentative of that particular amount of time. In this process, theoperation 2110 indicates a movement of one image (i.e., 1/24^(th) of asecond for 24 fps video) in the timeline.

The process also identifies (at 2115) the next image from the projectdata. In some embodiments, the project data is kept up to date withupdates to the project as the user modifies the clips in the project.When playing back a project (i.e., a media presentation), theapplication makes sure that the image being displayed is the correctimage for the most up-to-date version of the project data. In someembodiments, when the project data changes, the process receives anindication that this change has been made and retrieves the new projectdata. These changes may include movement of clips in the timeline,adding clips to the timeline, removing clips from the timeline, addingeffects to clips, etc.

With the image identified, the process 2100 performs (at 2120)operations required to display the image in the preview display area.This may involve a disk read operation, decode operation, any graphicsprocessing operations to generate a proper format image or combineimages, etc. In some embodiments, the image will have already beengenerated by a background rendering process or by pre-rendering duringplayback and at this stage the application just reads the generatedimage (e.g., from memory) and outputs the image.

The process then determines (at 2125) whether any more images need to beplayed back. If the user pauses the playback, then (at leasttemporarily) the application can cease outputting images. In addition,if the playhead reaches the end of the timeline, then playback willcease unless the user has set the application to playback the timelinein a continuous loop. When no more images remain, the process 2100 ends.

When additional images remain, the process determines (at 2130) whetherany user edits to the timeline are being received. These edits may bethe addition of effects, transitions, titles, etc., the movement ofclips, trimming of clips, removal of clips, or other edits that affectthe project displayed in the timeline.

When no such edits are received, the process returns directly to 2110 tomove the playhead and identify the next image. However, when edits arereceived, the process displays (at 2135) a modified timeline andmodifies (at 2140) the project data. The modified display may involvethe movement of a clip, the indication of an effect, etc. With themodification performed, the process proceeds to 2110 to move theplayhead and identify the next image.

IV. Editing Tools

A. Multi-Track Editing

FIG. 22 conceptually illustrates an in-line multi-tracked editing toolfor a timeline of a media-editing application. Specifically, this figureillustrates in four different stages 2205-2220 to show activating thein-line multi-tracked editing tool in a timeline 2200. The timeline 2200is similar to the timeline 115 described above by reference to FIG. 1 .

As described above, a media clip in some embodiments include differenttypes of media content. For instance, an audio and video clip has bothvideo and audio content. In some such embodiments, a media clip includesdifferent “tracks” for each type of media content. For instance, anaudio content of an audio clip may include several tracks for severalaudio channels. Likewise, a video content of a video clip may includeseveral tracks for a foreground video and a background video.

The media-editing application of some embodiments provides amulti-tracked editing tool. This multi-track editing tool is an in-linetool. That is, the media-editing application opens this multi-trackedediting tool within the timeline 2200 in some embodiments. Thismulti-tracked editing tool opens different tracks contained in a mediaclip in different lanes to allow the user to edit individual tracks ofthe media clip independently. In some embodiments, the multi-trackedediting tool opens different tracks of a media clip in a centralcompositing lane and a set of anchor lanes. Each lane will include atrack of a media clip in these embodiments. In some embodiments, themedia-editing application does not display in the tool any other mediaclips that were displayed in the timeline before the tool was opened.

The first stage 2205 shows the timeline 2200 before the media-editingapplication opens a multi-tracked editing tool for a media clip. Asshown, the central compositing lane 2230 displays two media clips 2235and 2240. The second stage 2210 illustrates the selection of the mediaclip that the user of the media-editing application wants to edit withthe multi-tracked editing tool. The user selects a media clip through acursor click operation, through a keystroke, through a selection from apull-down menu. The user has selected the media clip 2240 in thetimeline 2200.

In the third stage 2215, the media-editing application displays adrop-down menu 2245 that includes a selectable item which, whenselected, will cause the media-editing application to display themulti-tracked editing tool for editing the selected media clip 2240. Theuser selects (e.g., by a click operation) the item. The fourth stage2220 illustrates that upon receiving the selection, the media-editingapplication opens up the selected media clip 2240 in the in-linemulti-tracked editing tool. As shown, the lanes 2260 and 2270 displaythe individual video and audio tracks that make up the media clip 2240.

B. Precision Editor

FIG. 23 conceptually illustrates an example of an in-line precisionediting tool for a timeline of a media-editing application.Specifically, this figure illustrates a timeline 2300 five differentstages 2305-2320 to show the modification of the transition pointbetween media clips 2332 and 2334 in a timeline 2300 using a precisionediting tool of some embodiments. The timeline 2300 is similar to thetimeline 115 described above by reference to FIG. 1 .

The media-editing application of some embodiments provides a precisionediting tool that allows a user of the application to modify the pointat which one clip transitions into the next, trimming or extendingframes at the end of one clip and at the beginning of the next clip inthe same magnified view. The precision editing tool in some embodimentsdisplays both clips on either side of a transition such that the unusedframes (i.e., available media content of the source media files) fromboth clips. In this manner, the precision editing tool displays how theedits affect the transition from one clip to the next. In someembodiments, this precision editing tool is an in-line tool. That is,the media-editing application opens this multi-tracked editing toolwithin the timeline 2300.

The first stage 2305 shows the timeline 2300 before the user performs atransition modification operation between two media clips 2330 and 2335using a precision editing tool. The timeline 2300 displays media clips2330 and 2335 in the central compositing lane 2340.

The second stage 2310 shows the activation of the precision editing toolin the timeline 2300. The media-editing application provides variousways to activate the tool. For instance, the user may click a pointalong the timeline where two media clips 2330 and 2335 meet. In someembodiments, the user of the media-editing application may activate theprecision editing tool by a selection on a pull-down menu, by akeystroke, and a selection from a pop-up menu, etc. after selecting theadjacent edges of the two media clips. As shown, the media-editingapplication splits the central compositing lane 2340 into two lanes 2350and 2355.

The top lane 2350 displays the outgoing media clip 2330 as well as theadditional media content beyond the out-point of the media clip 2330. Asdescribed above, the additional media content beyond the out-point of amedia clip is in the source media clip of the media clip. Themedia-editing application displays a vertical line at the currentout-point of the media clip 2330 as shown. The vertical line separatesthe media clip 2330 and the additional media content.

The bottom lane 2355 displays the incoming media clip 2335 as well asthe additional media content beyond the in-point of the media clip 2335.The media-editing application displays a vertical line at the currentin-point of the media clip 2335. The vertical line separates the mediaclip 2335 and the additional media content. The vertical line in thebottom lane 2355 and the vertical line in the top lane are the samevertical line in some embodiments as shown. The user has also selected(e.g., by a click operation) the out-point of the outgoing media clip2330 to push out the out-point and include more frames in the mediaclip. The media-editing application highlights the bracket 2370 toindicate the selection of the out-point of the media clip 2330.

The third stage 2315 shows the movement of the edge 2370 that addsframes at the end of the outgoing media clip 2330. The user pushes outthe out-point of the media clip 2330 by dragging the edge 2370 of themedia clip 2330 to the right to include additional frames to the mediaclip 2330 from the source media clip. The vertical line that separatesthe media clip 2330 and the additional media content has moved tofurther right from the position where it was in the second stage 2315.The media-editing application has also moved the outgoing media clip2335 and its additional available media content to the right along withthe vertical line as the vertical line is moved to the right. Theposition of the vertical line with respect to the media clip 2335 andthe additional content for the clip 2335 did not change to indicate thatthe in-point of the media clip 2335 did not change.

The fourth stage 2320 shows that upon the user's completion in adjustingthe transition point between two media clips using the precision editingtool, the top track and the bottom track collapse back into one centralcompositing lane 2340. The user may indicate his completion in editingthe transition point by double clicking on the screen, making aselection on a pull-down menu, entering, a keystroke, etc. As shown, thetop and bottom tracks 2350 and 2355 have collapsed back into the centralcompositing lane 2340 for one continuous composite presentation upon theuser's signal. The central compositing lane the media clips 2330 and2330 in such a way to reflect the edit that was made through theprecision editing tool. That is, the media clip 2340 has been extendedand the media clip has rippled (i.e., pushed to the right along thetimeline 2300)

FIG. 24 illustrates an example of the movement of an anchored clip inthe middle of a transition modification operation (i.e., while theprecision editing tool is in operation). Specifically, this figureillustrates a timeline 2400 in four different stages 2405-2420 that themedia-editing application allows the user to move an anchored clip thatis anchored to a media clip displayed in the precision editing tool. Thetimeline 2400 is similar to the timeline 2300 described above in FIG. 23.

As described above, a central compositing lane splits into two lanes(i.e., a top lane and a bottom lane) at the point of transition betweentwo clips to allow the user to trim or extend the two media clips. Insome embodiments, the media-editing application displays anchor laneswhen any exists and allows the user to edit any anchored clips in thedisplayed anchored lanes.

The first stage 2405 shows the timeline 2400 before the user performs atransition modification operation between two media clips. The timeline2400 displays two media clips 2425 and 2430 in the central compositinglane 2435 and an anchored clip 2440 in an anchor lane 2445. The userselects (e.g., by a click operation) the neighboring edges of the mediaclips 2425 and 2430 as indicated by the highlighted brackets. A user ofthe media-editing application may select the neighboring edges (i.e.,the edit point 2450) by hovering the cursor at the transition point, byperforming a keystroke, etc.

In the second stage 2410, the media-editing application activates theprecision editing tool. The media-editing application splits the centralcompositing lane 2435 of the timeline 2400 into two lanes 2455 and 2460.

The third stage 2415 illustrates a selection of the anchored clip 2440while the precision editing tool is in operation. The user selects theanchored clip by performing a cursor controller operation, by performinga keyboard operation, by selecting through a pull-down menu, etc. Themedia-editing application highlights the border to indicate theselection of the anchored clip 2440 in the anchor lane 2445.

The fourth stage 2420 illustrates a movement of the anchored clip whilethe precision editor is still in operation. The user moves the anchoredclip 2440 by dragging the selected clip across the anchor lane, byincrementing the position of the anchored clip using numeric entry, bykeystroke, etc.

C. Editing Tools for Transition

FIG. 25 illustrates an example of adjusting a transition between twomedia clips in a timeline 2500 of a media-editing application.Specifically, this figure illustrates the timeline 2500 in fourdifferent stages 2505-2520 to show that the timeline displays atransition that becomes transparent as the transition is being adjusted.FIG. 25 illustrates media clips 2525 and 2530 and a transition 2535. Thetimeline 2500 is similar to the timeline 115 described above byreference to FIG. 1 .

A transition effect is an effect used to impact the transition from onemedia clip of a media presentation to the next media clip. There aremany types of transition effects well known in the art. A common type oftransition effect is a fade-out effect where the content of the outgoingmedia clip (i.e., the first clip of the two consecutive clips) graduallyfades out as the content of the incoming media clip (i.e., the secondclip of the two clips) gradually fades in.

To apply a transition effect between two adjacent media clips, bothmedia clips must have additional media content that overlap past theedit point in some embodiments. That is, the incoming media clip has tohave media content before its in-point and the outgoing media clip hasto have media content beyond its out-point. The media-editingapplication uses these additional media contents to show thetransitional effect instead of an abrupt cut between the two mediaclips. In the case of a fade-out, the additional media content of theincoming media clip starts to fade in before the clip's in-point (i.e.,before the outgoing clip's out-point). Likewise, the additional mediacontent of the outgoing media clip keeps fading out beyond the clip'sout-point (i.e., beyond the incoming clip's in-point).

The timeline 2500 in some embodiments displays a transition as arectangle between two media clips as shown in the second stage 2510 ofthis figure. In some embodiments, the media-editing application allowsthe user of the media-editing application to adjust the transition bymanipulating the rectangle. For instance, the media-editing applicationallows the user to grab either side edges of the rectangle to adjust thepoints in time at which the incoming media clip starts to fade in or theoutgoing media clip finishes fading out. The media-editing applicationmay also allow the user to perform a rolling edit (i.e., adjusting thein-point of the incoming clip and the out-point of the outgoing mediaclip at the same time) by grabbing and dragging a middle portion of therectangle.

When a transition is applied between two consecutive media clips, themedia-editing application in some embodiments covers portions of the twomedia clips with the rectangle such that the covered portions are notvisible in the timeline 2500. In some such embodiments, themedia-editing application displays the rectangle transparently such thateach of the two media clips is affected when the transition effect isadjusted. The media-editing application determines whether one or bothof the two media clips should be made visible as well as which of thetwo media clips should be made visible. The media-editing applicationdetermines this based on the position within the transition effect 2535on which the user performs a click operation. For instance, when theuser selects the right side edge of the transition 2535 to move it, thetimeline 2500 displays the transition 2535 transparently so that theaudio and video portions of the incoming media clip are visible to theuser as shown in the third stage 2515 of this figure. When the userselects the left side edge of the transition 2535 to move it, thetimeline 2500 makes the audio and video portions of the outgoing mediavisible through the transition 2535. When the user selects a middleportion of the 2535, the timeline 2500 makes the audio and videoportions of both media clips to show the edit point between the twoclips. The timeline 2500 may also provide a set of key commands to allowthe user to make the transition transparent.

In the first stage 2505, the timeline 2500 displays the media clips 2525and 2530. The user may select these two clips to apply a transitioneffect between them. The user selects these two clips and a transitioneffect to apply between them in many different ways that themedia-editing application provides. For instance, the user may selectthese two clips via click operations and select a fade-out from adrop-down menu.

In the second stage 2510, the user places a transition effect (e.g., afade-out) that the user has selected between the media clips 2525 and2530. The user selects the right edge 2545 of the transition effect 2535by a click operation. The timeline 2500 in some embodiments highlightsthe right edge 2545 of the transition to indicate the selection.

In the third stage 2515, the user starts to drag the selected edge 2545of the transition to the right. The timeline 2500 displays thetransition 2535 transparently and makes the video portion of the mediaclip 2525 visible through the transition 2535. In the fourth stage 2520,the user has dragged the right edge 2545 of the transition further tothe right and the video portion of the media clip 2525 shows the framesfrom the additional media beyond the initial in-point of the media clip.

FIG. 26 illustrates an example of adjusting a transition between twomedia clips in a timeline 2600 of a media-editing application.Specifically, this figure illustrates the timeline 2600 in fourdifferent stages 2605-2620 to show that the audio content and videocontent of the two media clips can be separately adjusted. FIG. 26illustrates media clips 2625 and 2630 and a transition 2635. Thetimeline 2600 is similar to the timeline 115 described above byreference to FIG. 1 .

As described above, a media clip in some embodiments contains one ormore types of media content (e.g., audio, video, text, image, etc.).When a transition is applied between two adjacent media clips in thetimeline 2600 of some embodiments, the media-editing application allowsthe user to adjust the transition such that the adjustment affects alltypes of media content that the two media clips have at the same time.For instance, the timeline 2600 allows the user to drag the right sideedge of a transition to adjust the point in time at which both the audioand video content of the outgoing media clip finish fading out. In somesuch embodiments, the timeline 2600 also allows the user to adjustdifferent types of media contents separately. For instance, the timeline2600 allows the user to adjust the audio contents of the two media clipswithout affecting the video contents of the two clips by manipulatingthe audio portions of the representations of the two media clips in thetimeline 2600. Also, the timeline 2600 allows the user to adjust thevideo transition independently from the audio transition. For instance,the timeline 2600 allows to move the video portion of the transition2635 along the timeline 2600 independently from the audio portion of thetransition 2635. Furthermore, the timeline 2600 allows the user toadjust one or more types of media contents at the same time and withoutaffecting the media clips' other contents.

In the first stage 2605, the timeline 2600 displays the media clips 2625and 2630 along with another media clip before the media clip 2625. Theuser has also placed a transition 2635 between the media clips 2625 and2630.

In the second stage 2610, the timeline 2600 displays a menu bar 2640that appears when the user clicks on the transition 2635. The userselects an item that will result in displaying the audio portions of thetwo media clips separately from the video portions of the media clips.The timeline 2600 may provide numerous different ways of causing thetimeline to display the audio portions separately. For instance, thetimeline 2600 may provide hotkey commands that causes the timeline 2600to display the audio portions separately.

In the third stage 2615, the timeline 2600 displays the audio portion ofthe media clip 2625 further away from the video portion of the mediaclip 2625. The timeline 2600 displays the audio portion of the mediaclip 2630 away from the video portion of the media clip 2630 and belowthe audio portion of the media clip 2625. Parts of the audio portionsspan the same duration 2645 of the timeline 2600 to indicate that theaudio content of the media clip 2625 is fading out over this durationand the audio content of the media clip 2630 is fading in over thisduration. The diagonal lines that appear in the audio portion in someembodiments indicate that this fading effect currently applied to theaudio contents of the two media clips are preset by the media-editingapplication. The media-editing application allows the user to select thevideo portion of the transition independently from the audio portions ofthe transition. For instance, the user can select (as indicated by thehighlighted border of the video portion of the transition) and move tothe left or to the right to adjust video transition.

In the fourth stage 2620, the user has dragged the left edge of theaudio portion of the media clip 2630 to the left in order to make theaudio content of the media clip 2630 starts to fade in at an earlierpoint in time than before. The timeline 2600 in some embodiments mayalso allow the user to adjust video portions of the two media clips bymanipulating the transition 2635. For instance, the user can drag thetransition 2635 to the left without affecting the audio portions of thetwo media clips in order to adjust the points in time at which the videocontents of the two media clips start to fade in or finish fading out.

The media-editing application has removed the diagonal line for theaudio portion of the media clip 2630. This indicates the fade-in effectis not governed by the preset pattern represented by the diagonal line.The user will have to apply a fade-in effect as the user desires usingfade handles similar to the fade handles 221 and 222 described above byreference to FIG. 2 .

D. Moving Clips While Trimming

FIG. 27 illustrates expanding a space before the first media clip of amedia presentation that is displayed in a timeline 2700 of amedia-editing application. Specifically, this figure illustrates thetimeline 2700 four different stages 2705-2720 to show that a spacebefore a media clip 2725 expands as the in-point of a media clip 2725 ispulled in to trim the media clip 2725 from its beginning. The timeline2700 is similar to the timeline 115 described above by reference to FIG.1 .

When a media clip in the timeline 2700 of some embodiments is trimmedfrom its beginning (i.e., when the media clip's in-point is pulled in),the media-editing application moves the media clips that come after themedia clip being trimmed to the left while leaving the media clips thatcome before the media clip being trimmed static. This results in animpression to the user that the media clip that is being trimmed istrimmed from its ending. That is, this gives an impression that theout-point of the media clip that is being trimmed is pulled in. Toprevent such impression from occurring, some embodiments of the mediaapplication moves the media clips that come before the media clip beingtrimmed from its beginning to the right.

The first stage 2705 shows the timeline 2700 before the user performs atrimming operation to the media clip 2730 in the timeline 2700. Thetimeline 2700 displays the media clips 2725 and 2730 in the centralcompositing lane 2735. The timeline 2700 also displays a rectangularspace 2736 before the beginning of the sequence of the two media clips(i.e., before the media clip 2725). The second stage 2710 illustratesthe selection of the left edge of the media clip 2730 in the timeline2700. The left edge of the media clip 2730 is the current in-point ofthis media clip 2730.

The third stage 2715 illustrates the shortening of the media clip 2730as the user of the media-editing application moves the right edgetowards the center of the media clip. As the right edge of the mediaclip moves towards the center of the media clip 2730, the media-editingapplication shortens the length of the media clip 2730 while leaving theright edge of the media clip 2730 static. Also, the media-editingapplication moves the media clip 2725 to the right and expands the space2736 accordingly. In this manner, the media-editing applicationgenerates an impression that the media clip 2730 is trimmed from itsbeginning, not from its end. The fourth stage 2720 illustrates that,upon the performance of another operation, the media-editing applicationmoves all media clips in the timeline 2730 to the left so as to contractthe space 2736 to the length it originally had before the trimmingoperation initiated. In this example, the user has moved a scroll bar2716 to the right.

V. Data Structures

In some embodiments, the media-editing application is an applicationthat enables a user to create a composite media presentation from a setof media files. Through a graphical user interface (GUI) of theapplication, the user specifies the manner in which the media files arecomposited to create the composite presentation. In addition, throughthis GUI, the user can command the application to import one or moremedia files (e.g., from a camera, from an external drive, from aninternal drive, etc.). Upon instructions from the user (i.e., throughthe media-editing application GUI) or as an automatic response to thedetection of the media files in an external storage, the applicationcopies the media files to a particular media storage location on aparticular storage device. Some embodiments create a particular folderwithin the folder structure of the storage device for a set of importedmedia files (i.e., the media files imported at a particular time) andstore a copy of the imported files in this particular folder at time ofimport.

When importing a media file, some embodiments create a media clip datastructure for the imported media that links to the media file, anytranscoded versions of the media file, and any analysis data about themedia file. This media clip is the entity that is added to a mediapresentation in some embodiments in order to include the media file (ora portion of the media file) in the composite presentation. Someembodiments store this information in an asset data structure thatspecifically references the media and analysis files, and thenadditionally create a clip data structure that references the asset. Inaddition, the asset data structure may include metadata such as a UUIDfor the media file generated by the camera that captured the media, fileformat information, various video properties (e.g., frame rate,colorspace, pixel transform, dimensions, etc.), and various audioproperties (e.g., channel count, track count, sample rate, etc.) of themedia.

The references stored in the media clip (or asset) refer to the versionsof the media file stored in the application's file storage. Someembodiments, for each set of imported media files, create separatefolders for the original media and any type of transcoded media. In someembodiments, the transcoded media include both high-resolution andlow-resolution encodes of the original media file that may be created onimport or post-import.

In some embodiments, these references to the files are pointers to thelocations of the files on the storage device. In some embodiments, themedia-editing application initially sets the reference to the originalmedia such that the data structure references the media file that is tobe imported (e.g., the file on a camera) as the original media, thenmodifies this reference once the media file is copied to theapplication's file storage so that the data structure now references themedia in the file storage. In some such embodiments, the applicationdisplays the media clips for the user to edit before the file isactually copied. This enables a user to begin creating a presentationusing the media clip while the clip refers to a file stored on a camera,and then continue using the same clip once the file is copied with nointerruption to the editing workflow.

Much like the folders for different versions of media files, someembodiments create separate folders within a folder for a set ofimported files for each type of analysis file (e.g., a folder for persondetection files, a folder for color balance files, a folder for shakedetection files, etc.). In addition, some embodiments store additionalclip data in the media clip, as opposed to a separate file. As oneexample, some embodiments store shake detection as a tag about the mediafile or a specific portion of the media file.

FIG. 28 conceptually illustrates a process 2800 of some embodiments forcreating an asset data structure and a clip data structure referencingthat asset. In some embodiments, process 2800 is performed as part ofthe import process of the media-editing application. The process 2800will be described in part by reference to FIGS. 29 and 31 . FIG. 29conceptually illustrates an asset data structure 2900 for a video asset,as well as an event data structure 2905 for an event that contains thevideo asset. FIG. 31 conceptually illustrates a simplified clip datastructure 3100 that contains a single asset.

As shown, the process begins by receiving (at 2805) a media file toimport. The media file may be an audio file, a video file, or other typeof media file. In the example shown in FIG. 29 , the media file is avideo file with audio channels (e.g., a “.mov” file).

Next, the process creates (at 2810) an asset data structure for themedia file. At this point in the process, the asset data structure is anempty structure. Some embodiments define the data structure in aCoreData (SQLite) database file, an XML file (e.g., an XML file for anevent), etc. As mentioned, FIG. 29 illustrates an asset data structure2900 for the media asset. The asset data structure 2900 is fullypopulated, and this data will be described further below.

In some embodiments, the asset data structure is created within an eventdata structure. If the event data structure does not yet exist, then themedia-editing application also creates this data structure to containthe asset. As shown in FIG. 29 , the asset data structure 2900 is oneasset within the event data structure 2905. The event data structure2905 includes an event ID 2910, the list of assets, and a list of clips.The event data structure may include additional fields in someembodiments, such as the event name, event date (which may be derivedfrom asset information), etc. The event data structure 2905 may be aCoreData (SQLite) database file that includes the assets and clips asobjects defined with the file, an XML file that includes the assets andclips as objects defined with the file, etc.

The process next retrieves (at 2815) metadata from the imported file,and then stores (at 2820) this metadata in the asset structure. Themetadata is information about the source file and its stored media insome embodiments. In some embodiments, this metadata is used to generatethe asset ID, described below. The asset data structure 2900, as shown,includes source file metadata 2915. As shown, the source file metadataincludes the file type (e.g., audio, video, movie, still image, etc.),the file format (e.g., “.mov”, “.avi”, etc.), the source device (i.e.,the device that created the media, such as the particular type of cameraon which a movie file was captured), the file creation date (e.g., thedate a video was captured, rather than the date of import), a UUID (aunique identifier generated by a media creation device such as acamera), set of video properties 2920, a set of audio properties 2925,and additional metadata. Different types (or manufacturers) of camerascreate different UUIDs differently. These may be hashes of various datain some embodiments, such as a camera ID, record time (e.g., the time auser of the camera started recording, the duration of the video), etc.,so long as no UUIDs will always be unique.

The video properties 2920 of some embodiments include such properties asa sample rate, a frame rate (i.e., the number of video images the videofile contains per second, often 24, 25, or 30), the dimensions of theimage (i.e., the number of pixels horizontally and number of rows ofpixels), the pixel aspect ratio (i.e., the shape of the pixels, whichmay be square (HD video) or rectangular (e.g., NTSC video has a ratio of10:11)), the pixel transform, and the colorspace in which pixel valuesof the image are defined (e.g., ITU-R BT.709 for HD, ITU-R BT.601 forSD, etc.). The audio properties 2925 of some embodiments include asample rate (i.e., the number of audio samples per second, often 48kHz), the number of audio tracks stored in the underlying media file,and the number of audio channels stored in the underlying media file. Insome embodiments, the asset may additionally store override data thatmodifies one or more of the video or audio properties. For instance, auser might enter that a media file is actually 1080p, even though thefile's metadata, stored in the asset, indicates that the video is 1080i.When presented to the user, or used within the application, the overridewill be used and the media file will be treated as 1080p.

Returning to FIG. 28 , the process 2800 then creates (at 2825) an assetID and stores the asset ID in the asset structure. The asset ID, in someembodiments, is a function of various properties of the underlying mediafile. For instance, some embodiments generate the asset ID as a hash ofproperties such as a file identifier, video properties, audioproperties, and media range. The creation of the asset ID will bedescribed in further detail by reference to FIG. 30 . As shown in FIG.29 , the asset ID 2910 is stored in the video asset 2900.

With the asset created, the process 2800 then begins populating theasset with references to various data. The process stores (at 2830) areference to the original media file in the asset structure. Asdescribed above, this reference initially refers to the media file onthe device from which the application is importing the file (e.g., thecamera), and then once the file is copied to the application's folderstructure, the reference is modified to refer to the copied media file.

Next, the process 2800 creates (at 2835)) a clip data structurecontaining a reference to the asset, in some embodiments, a clip iscreated for each asset. As will be described below, clip data structures(e.g., clip objects) can also contain other clips, and some embodimentsuse the same data structure for single asset clips, compound clipscontaining multiple assets and/or nested clips, and project sequences.The clip data structure, like the asset, is contained in the event datastructure in some embodiments. Some embodiments create a series ofnested clip objects for an imported clip, as described in further detailbelow. The lowest clip object in the nested hierarchy references theasset.

Next, the process determines (at 2840) whether any transcoded versionsof the media are generated by the media-editing application. Asdescribed in subsections A and B above, some embodiments generate one ormore transcoded versions of imported media files in formats that arebetter suited for editing. This may be an automatic process based on theimported file properties, or based on user selection of whether totranscode the media. When one or more transcoded versions of the mediaare created, the process stores (at 2845) references to any suchtranscoded versions of the media file in the asset data structure.

The process also determines (at 2850) whether any analysis data isgenerated for the media by the media-editing application. As describedabove, some embodiments generate data about the video and/or audio dataof a media file. This data may be generated automatically or based onuser selection of particular analysis operations. When one or moreanalysis data files are created, the process stores (at 2855) referencesto any such analysis data files in the asset data structures. Theprocess 2800 then ends.

The media asset 2900 of FIG. 29 includes references to three versions ofthe underlying media file: a copy of the original media file 2930, ahigh resolution transcoded media file 2935, and a low resolutiontranscoded media file 2940. In addition, the media asset includesreferences to a person detection file 2945, a color correction data file2950, and a shake correction data file 2955. These data files aredescribed in further detail in the subsections above. In someembodiments, the references stored in the asset data structures arepointers to the locations of the video on a physical storage device(e.g., the boot disk of the device on which the media-editingapplication operates). In the case of media asset 2900, the underlyingfile stores both audio and video. In some media formats, different filesare used to store video and audio for a single shot (and there may bemultiple audio files recorded by different audio recorders in somecases). In this case, some embodiments create separate assets for eachfile. In some embodiments, each media file gets its own asset datastructure.

As mentioned in the discussion of FIG. 29 , the asset ID for aparticular asset may be generated using various properties of theasset's underlying media file. FIG. 30 conceptually illustrates aprocess 3000 of some embodiments for generating the asset ID and storingthe ID in the data structure. In some embodiments, process 3000 isperformed at operation 2825 of process 2800.

As shown, the process 3000 begins (at 3005) by receiving a media file(e.g., a video file, audio file, movie file, etc.). The process thenidentifies (at 3010) the media file ID, video properties, audioproperties, and media range of the media file. As shown in FIG. 29 ,these may be stored as metadata of the source media file. The media fileID, in some embodiments, is a UUID generated by a camera that shot themedia file, as described above. In some cases, the file may not have aUUID (e.g., if the device that captured the file does not generateUUIDs), and some embodiments will instead use the file name. The videoproperties used in some embodiments are the dimensions, colorspace,field dominance, sample duration, frame duration, pixel transform, andpixel aspect ratio, though different video properties may be used indifferent embodiments. The sample duration may be different from frameduration if, for example, the video is field rendered, in which case theframe duration is twice the sample duration. The frame duration, in someembodiments, is the inverse of the frame rate (e.g., if the frame rateis 30 fps, then the frame duration is 1/30 of a second). The audioproperties used in some embodiments are the number of tracks, number ofchannels, and sample rate (i.e., the same as shown in audio properties2925). Some embodiments include additional properties, such as the filecreation date (i.e., the date and/or time at which the media wascaptured (e.g., filmed, photographed, recorded, etc.)).

The media range indicates the range of the original media file referenceby the particular asset. Some embodiments use timecode values of themedia file to define the media range. Thus, if a file is split apart(e.g., a user might take a thirty minute video and split it into atwelve minute video, a seven minute video, and an eleven minute video,as well as retain the original), the different timecodes willdifferentiate the assets. The media range can also be used if one of theassets goes missing, as an asset with identical properties and a rangeincluding the media range of the missing assets can be used to restorethe missing asset.

The process then generates (at 3015) a hash of the identified propertiesof the media file. Different embodiments use different hash algorithms(e.g., MD5, etc.). The process then stores (at 3020) this generated hashin the asset structure as the asset ID. While the process 3000 describesone method of computing an asset II), one of ordinary skill willrecognize that asset IDs can be computed using many different propertiesand many different computation algorithms.

As mentioned above, some embodiments use a clip structure thatreferences one or more assets when importing a media file. FIG. 31illustrates a component clip data structure 3100 of some embodimentsthat references an asset. In some embodiments, the component clip 3100is the lowest level of a set of nested clip objects, that are allmembers of the same class. The details of clip objects of someembodiments will be described below by reference to FIG. 32 .

The component clip 3100 includes a clip ID, clip attributes (describedin more detail below), and an asset reference 3105. The asset reference3105 of some embodiments stores an event ID and an asset ID, anduniquely identifies a particular asset data structure, as indicated bythe dashed arrow referring to an asset. The arrow is shown as dashedbecause the asset reference is not a direct reference to the asset, butrather is used to locate the asset when needed. When the media-editingapplication of some embodiments needs to identify a particular asset,the application uses the event ID to locate the event that contains theasset, and then the asset ID to locate the particular desired asset.

FIG. 32 conceptually illustrates a nested sequence of clip objectscreated by the media-editing application of some embodiments for animported media file. In some embodiments, each of the clip objects shownin this figure is a member of the same class, though the object may beof different sub-classes. The media file whose clip structure isillustrated in FIG. 32 is a movie file that stores both audio and videoinformation.

The figure illustrates a sequence 3205, a collection 3210, and twocomponents 3215 and 3220. As mentioned, these three types of objects areall subclasses of clip objects (or anchored objects) in someembodiments. Some embodiments create a sequence within an event objectfor each imported media clip. The sequence 3205 stores a sequence ID, aset of sequence attributes, and the collection object 3210. The sequenceID is a unique identifier for the sequence object. The sequenceattributes, in some embodiments, include video properties for thesequence, such as the resolution, frame rate, etc. The attributes may beset by a user in some embodiments, or set automatically based on theunderlying media.

The collection object 3210 is an ordered array of clip objects. In thecase of a clip imported into an event, as is the case with object 3210,the collection stores one or more component clips in the array. Often,the collection only stores the video component clip in the array, asshown here; any additional components (generally one or more audiocomponents) are then anchored to that video component. In addition, thecollection object 3210 stores a collection ID, a total range, and atrimmed range. The collection ID is a unique identifier for thecollection object. The total range of a clip object indicates themaximum range for the object based on the objects it contains, while thetrimmed range indicates the actual range of the object in its parentobject according to user edits. In some embodiments, the collectionobject stores a value for the total range because the total range is avariable assigned to all types of clip objects, but this range is notactually used by the application. Instead, the application dynamicallycalculates the total range based on the objects contained by thecollection (as opposed to updating the range value every time a clip isadded to the collection). Some embodiments, on the other hand, do updatethe total range in the collection object. These ranges will be describedin further detail below by reference to FIG. 33 . The array of thecollection object includes two media components 3215 and 3220.Collection objects, in some embodiments, can include component clipobjects as well additional collections.

In the above paragraph and elsewhere in this section, a first object(e.g., the collection object 3210) is described as containing a secondobject (e.g., media component 32 in the collection object's array). Insome embodiments, a first object contains a second object by storing areference to the object (e.g., a pointer). This reference is a strongpointer in some embodiments.

The media components shown include a video component 3215 and an audiocomponent 3220. These are the same data structures as the component clip3100, in some embodiments, and thus store the clip attributes and theasset reference shown in that figure. Each of the components stores acomponent ID (i.e., the clip ID of FIG. 31 ), a source media range(i.e., total range) and a trimmed range. For a component clip thatrefers to a media asset, the total range is the duration of the sourcemedia. The trimmed range is the range selected by a user through varioususer edits (e.g., trim edits) and indicates both the start time withinthe total range and the duration, in some embodiments. The trimmed rangeis generally a subset of the total range (i.e., does include timeoutside the total range). However, in some embodiments, the applicationmay use a range extender to extend the trimmed range past the totalrange (e.g., when needed for part of a transition, or if aligned audioruns slightly longer than video). Some embodiments will generate videoimages using, e.g., the first and last images of the video file, to fillin the needed extra range. When a clip is initially imported into theapplication, the total range and trimmed range will generally be equalas the user will not have edited the clip at all yet.

The video component 3215 includes an anchored item set that contains theaudio component 3220. As described above by reference to the timeline115 in the user interface 100 of FIG. 1 , clips can be anchored to otherclips in some embodiments. When a particular clip is moved in atimeline, any clips anchored to the particular clip are moved along withit. Each clip can have numerous clips anchored to it, and can beanchored to a single clip. In the case of a media clip with audio andvideo components, some embodiments anchor the audio component to thevideo component. Thus the video component object 3215 contains the audiocomponent in its set of anchored items (and could include numerous suchitems if there were additional audio components), while the audiocomponent object 3220 includes a parent item reference to the videocomponent to which it is anchored. In addition, the child (anchored)object stores an anchor offset that indicates two values. The firstvalue is the position in the parent object to which the child object isanchored, and the second value is the offset within the child object ofthe anchor. In the case of an imported media file, the audio and videocomponents will start at the same time, and thus both anchor offsetvalues are zero. However, this can be modified if, for example, there isa slight offset in the recordings of the two components and the user hasto adjust the audio relative to the video.

FIG. 33 conceptually illustrates the objects 3205-3220 nested in aconceptual timeline. The figure shows video and audio components 3215and 3220 inside the collection 3210, which is nested inside the sequence3205. The audio component 3220 is anchored to the video component 3215;specifically, as shown by the thick arrow 3305, the start of the audiocomponent is anchored to the start of the video component.

The figure also includes a dashed box 3310 that illustrates that a userhas trimmed the clips so that portions at the beginning and end of theclip are not part of the sequence were it to be rendered. Thus, thetotal media range of the components is the full length of the media towhich they refer, whereas the trimmed range is a subset of this rangebased on the user edits. In some embodiments, all clip objects store atotal range and trimmed range. The collection 3210, in this case, willhave the same total range and trimmed range as the components. However,if the components were offset, or if the collection included additionalobjects, it would have larger trimmed and total ranges. For sequenceobjects, the total range and trimmed ranges are always equal in someembodiments. In the illustrated case, the sequence 3205 has a rangeequal to the trimmed range of the collection 3210. As the user edits theobjects in the sequence, both the trimmed and total ranges of thesequence change. In some embodiments, these ranges are based on units oftime, number of frames, and/or number of audio samples. As describedabove by reference to FIG. 2 , the media-editing application of someembodiments provides a volume control for a user of the application tocontrol the volume of a media clip displayed in the timeline.

FIG. 34 illustrates a timeline 3400 with a project title “New Project”that includes four clips 3405-3420. The clips 3405-3415 are in theprimary compositing lane of the project's sequence, while the clip 3420is anchored to clip 3410 at approximately 26 seconds into clip 3410. Theclip 3410 is a compound clip that itself includes two clips.

FIG. 35 conceptually illustrates a subset of the data structures for thesequence illustrated in FIG. 34 . In some embodiments, the datastructures of FIG. 35 are all contained within a project data structurethat contains a single sequence. In some embodiments, the project datastructure for a project in the timeline is a sub-class of a class thatalso includes event data structures. Unlike the project data structures,the event data structures can contain multiple sequences, and in factcontain a sequence (such as sequence 3305) for each clip in the event.

FIG. 35 illustrates a sequence 3500 that includes a primary collectiondata structure 3503, which itself is an array of three collections3505-3515 that correspond to the clips 3405-3415. In addition, thefourth clip 3420 is stored as a data structure within the collection3510. For simplicity, the component objects are not shown in thisfigure. The sequence 3500 includes a sequence ID, sequence attributes,and the primary collection 3503. The sequence attributes for a projectin the timeline are set by a user when creating the project, in someembodiments.

The primary collection 3503 includes the collection ID, total andtrimmed range, and the array of media clips. In some embodiments, thearray is ordered based on the location in the timeline and only includesmedia clips in the primary lane of the collection. The applicationassumes that there is no gap between these items, and thus no timingdata is needed between the items. As shown, each of these clips isrepresented as a collection. When a clip stored in an event (e.g., theclip shown in FIG. 32 ) is added to a project in a timeline, someembodiments remove the sequence container data structure (e.g.,structure 3205) and copy the rest of the structure (i.e., the collectionand its components) into the data structure for the object in thetimeline.

Clips 3505, 3515, and 3520 are individual clips that have been added tothe timeline from the clip browser, and thus do not themselves includecollections. Similar to the collection 3210, these objects include anID, total and trimmed ranges, and an array of media components (e.g., avideo component and one or more audio components).

The clip 3510 is a compound clip and therefore includes multiple clipsin addition to the collection ID and ranges. Specifically, the clip 3510includes two media clips 3525 and 3530. Within the collection, the clipsare both in the primary lane of the collection, and thus one follows thenext. These clip objects are not shown in this figure, but each of theclips is similar to clip 3505 in that the clips include an array ofmedia components. In addition, the clip object 3510 includes a set ofanchored items (in this case only the one item, clip 3520). Someembodiments include a set of anchored items for each collection, whichare empty for the other objects shown in this figure. The anchor offsetstored in clip 3520 indicates that it is anchored 26 seconds into clip2, and that the anchor is at the start of clip 3520. These times referto the trimmed ranges of the clips in some embodiments.

When one of clips 3405, 3510, and 3515 is removed from the spine andplaced in the anchor lane above the spine like clip 935 does asillustrated in FIG. 9 above, the corresponding entry in the mediacomponent array of the primary collection 3503 will be removed from thearray and the primary collection will include an anchored item thatassociates with the collection for the removed clip. The collection forthe removed clip will then include anchored offsets. Conversely, whenanchored clip 3420 is inserted into the spine as the second mediacomponent of the primary collection 3503 like clip 1025 does asillustrated in FIG. 10 above, the primary collection will create anentry for the collection #9220 in the array of the media components. Theanchored offsets will be deleted from the collection 3520. Also, theanchored item for the collection 3520 in the collection 3510 will bedeleted. When the anchored clip 3420 is moving along the timeline asclip 1130 does as illustrated in FIG. 11 above, the first value of theanchor offsets in the collection 3520 will be modified accordingly.

FIG. 36 conceptually illustrates the objects 3500-3230 nested in aconceptual timeline. As shown, collection objects 3525 and 3530 arenested inside the collection 3510, which is nested inside the primarycollection object 3503 along with the collection objects 3505, 3515, and3520. The collection object 3503 is itself nested inside a sequenceobject.

The figure illustrates the anchoring relationships between the variousclips as well as the durations (ranges) of the clips. As with the clipobjects shown in FIG. 33 , each of the lowest level collections 3505,3515, 3525, and 3530 each have an audio component anchored to a videocomponent. While not shown, collection 3520 could also have the samevideo/audio setup, or could be just a video component (or just an audiocomponent). While each of the objects shown has a single audiocomponent, one of ordinary skill will recognize that some embodimentswill have multiple audio components (e.g., if a camera records severalaudio tracks as separate files and imports the files with a video fileas part of a single clip).

The figure also illustrates the anchoring of clip 3520 to clip 3510. Insome cases, multiple clips will be anchored to the same primary laneclip, and the multiple anchored clips may overlap in time. In this case,multiple secondary lanes may be used. Some embodiments assign lanenumbers to each clip object that indicates the clip object's lane withina collection.

All of the primary lane objects are assigned a lane number of zero insome embodiments, with lanes above the primary lane getting increasingnumbers and lanes below the primary lane getting decreasing (negative)numbers. For instance, a separate audio clip might be anchored to a clipin the primary lane and displayed below the primary lane. In this case,within the primary collection 3503, the anchored clip 3520 has a lanenumber of 1. The lane numbers indicate compositing order for video insome embodiments. Whereas two audio files can be combined fairly easily(mixed), two video files cannot be displayed at the same time. Thus,some embodiments composite higher lane number clips on top of lower lanenumber clips. If no compositing effect is defined between two clips atthe same time, then the clip in the higher lane will be displayed.However, various compositing modes and effects may be used to combinethe pictures (e.g., compositing modes such as subtract, darken,multiply, etc. that combine pixel information of two images, as well aseffects such as scaling the top image to get a picture-in-picture,applying a color mask to the top image, etc.).

The items in a lower-level nested collection will also have lane numbersthat refer to their lane order within that collection. For example, thecollection object 3510 has two clips 3525 and 3530, that each have alane number of zero. However, this collection object could have anchoredclips in multiple lanes. For the purpose of compositing at time ofrendering, the items within the collection 3510 would be compositedinitially according to the ordering within the collection, then theoutput of that would be composited within the primary collectionaccording to the ordering of the primary collection. Similarly, for eachof the lowest-level collections (e.g., collection 3505), the videocomponents are all lane zero and the audio components are lane −1.

FIG. 36 also illustrates the ranges (e.g., durations) of the variousclip objects. For the lowest level collections and their components(e.g., collections 3505, 3515, 3525, 3530, and 3520), the trimmed rangeand the total range are determined in a manner similar to that shown inFIG. 33 for the collection object 3210. In this case, collections 3515and 3555 are not trimmed at all, whereas collection 3505 is trimmed onboth sides and the start of collection 3530 is trimmed.

For collection 3510, the total range is the sum of the trimmed ranges ofits primary lane clips, which in this case are collections 3525 and3530. Thus, the variable Total Range 2=Trimmed Range A+Trimmed Range B.In this case, the collection 3510 is not separately trimmed, such thatits trimmed range equals its total range. This means that, althoughthere is more media within clip 3530, while editing the primarycollection 3503 the media-editing application will not allow a user toincrease the duration of clip 3510 beyond that of Total Range 2.However, a user could open up the clip 3510 in the timeline and applytrim edits to either of clip 3525 and 3530. Modifications to the trimmedrange of these clips will affect the total range of the clip 3510. Inaddition, within the primary collection 3503, a user can modify thetrimmed range of clip 3510 to shorten the clip. Trimming from thebeginning would result in less of the media of collection 3525 beingused in the component presentation, while trimming from the end wouldresult in less of the media of collection 3530 being used in thecomposite presentation.

The above figures illustrated various aspects of different subclasses ofclip objects (e.g., sequences, collections, and components). One ofordinary skill will recognize that clip objects of some embodiments mayhave additional properties not shown in these figures. For instance,both collections and components may have an effect stack in someembodiments, which stores a stack of effects that are applied to themedia in the clip when the application renders the clip. The applicationapplies these affects to the media in an order designated by the effectsstack, which can be modified by the user during editing. The effects mayinclude audio effects that perform a transform on the audio or videoeffects that apply a function to the pixel values of the video images,in some embodiments. In fact, some embodiments store separate video andaudio effects stacks.

In addition, one of ordinary skill in the art will recognize that someembodiments may have additional different subclasses of clip objects.For instance, some embodiments store generators, transitions, auditionstacks, markers, and keywords as clip objects. A generator, in someembodiments, is an effect used in a composite presentation that createsits own video images rather than modifying existing images (e.g., cloudsand other computer-generated effects that may rely on random processes).Some embodiments also use generators as gap elements (e.g., a positionclip) in collections in specific circumstances. If, for example, a userwere to select clip objects 3505 and 3520 and create a compound clipfrom these objects, a gap element would be inserted into the collectionobject for the compound clip to take up the missing space of clip object3510, which the user did not add to the collection. The clip object 3520would then be anchored to this gap element. In some embodiments, theseclips are not actually generators, but are special clips that produceneither audio nor video but add duration to a collection. As thegenerators create their own video images, they have a duration and thisduration adds to the range of the collection containing the generator.

Transition objects, on the other hand, are used for transitions betweentwo other clip objects. These objects have a range of 0, and do not addto the range of the container clip object. A transition object is storedin the array of its containing collection with an index between theindices of the two items between which it transitions. The transitionobject has a head and a tail that indicate the start and end of thetransition between the clips.

Audition stack objects, or variants, store a list of possible clips fora particular index in a collection or for a particular anchor. That is,the audition stack object stores a set of clips, one of which isdesignated as active at any time. The properties of the stack objecttake on the properties of the active clip, such as the ranges, videoproperties e.g., frame rate, resolution, etc.), audio properties, etc.Thus, when a user switches the active clip in the stack, some attributesof the stack may change. In addition, some of the objects in the stackmay be collections that themselves have nested clips, while others mightbe simpler clip objects. When an audition stack object is anchored toanother clip, some embodiments store the first portion of the anchoroffset in the audition object (i.e., the offset within the parent clip),but store different offsets within the child clip for the differentclips in the audition.

Marker objects store markers that a user adds to a specific timelocation in a collection. In some embodiments, marker objects have aduration of 1 frame, and store metadata indicating the type of marker(e.g., to do marker, analysis marker, etc.) and any notes about themarker that the user adds. Some embodiments anchor marker objects to aparticular clip object. When calculating the duration of a collection,marker objects are specifically excluded from this calculation in someembodiments.

Finally, keyword objects store keyword tags about a clip object. Unlikemarkers, keywords have a range, as some embodiments provide the user theability to tag a particular range of a clip rather than just associatingthe keyword with the entire clip. In some embodiments, a keyword objectcan store multiple keywords that have the same range. Some embodimentsanchor keyword objects to the tagged clip object at the start of therange within the tagged object. Like markers, some embodimentsspecifically exclude keyword objects from the duration calculation for acollection.

FIG. 37 conceptually illustrates a state diagram 3700 for amedia-editing application of some embodiments. Specifically, statediagram 3700 refers to the creation and modification of clip data due tovarious user actions. As shown, when the application is not receivingany such actions, the application is in the wait state 3705.

When a user imports a file, the application transitions to 3710 tocreate a clip object in an event for the imported file. The event mayalso need to be created, depending on whether the user is importing thefile to an existing event. The clip object, as shown above, refers to anasset that refers to the file. The application then returns to the waitstate 3705.

When the user adds a clip to the timeline (e.g., by dragging the clipfrom the browser to the timeline), the application transitions to 3715and duplicates the clip object from the event to create a new clipobject that is part of the project currently edited in the timeline. Theclip data is partly the same (i.e., the same asset reference), but mayalso refer to only a portion of the asset (i.e., may have in and outpoints). In addition, the application transitions to 3720 to addinformation for the new clip object to the timeline clip objectattributes. That is, the timeline is also represented by a clip objectin some embodiments (e.g., may be a project, compound clip, etc.) andthis data structure will be modified to refer to the new clip and storethe position of the new clip. The application then returns to the waitstate 3705.

When the user duplicates a clip in the timeline (as opposed to adding aclip from the browser), the application transitions to 3725 to duplicatethe clip object from the clip in the timeline. This is a similar processas described above at state 3715. In addition, the information about thenew clip is added to the timeline clip object at state 3730.Furthermore, at both state 3730 and state 3720, clip information in thetimeline clip object may need to be modified to account for movement ofother clips.

When the user edits a clip in the timeline (e.g., moves the clip), theapplication transitions to 3735 to modify the information for the editedclip object in the timeline clip object attributes this may involvemodifying its horizontal (time) and/or hierarchical position if the clipis moved. In addition, if the clip is trimmed, the information in theedited clip may need to be changed (i.e., its in and out points in thesource media).

VI. Software Architecture

In some embodiments, the processes described above are implemented assoftware running on a particular machine, such as a computer or ahandheld device, or stored in a machine readable medium. FIG. 38conceptually illustrates the software architecture of a media editingapplication 3800 of some embodiments. In some embodiments, the mediaediting application is a stand-alone application or is integrated intoanother application, while in other embodiments the application might beimplemented within an operating system. Furthermore, in someembodiments, the application is provided as part of a server-basedsolution. In some such embodiments, the application is provided via athin client. That is, the application runs on a server while a userinteracts with the application via a separate machine remote from theserver. In other such embodiments, the application is provided via athick client. That is, the application is distributed from the server tothe client machine and runs on the client machine.

The media editing application 3800 includes a user interface (UI)interaction and generation module 3805, a media ingest module 3810,editing modules 3815, rendering engine 3820, playback module 3825,timeline features module 3895, playhead control module 3830, multi-trackeditor 3835, and precision editor 3845.

The figure also illustrates stored data associated with themedia-editing application: source files 3850, events data 3855, projectdata 3860, layout data 3890, and render files 3865. In some embodiments,the source files 3850 store media files (e.g., video files, audio files,combined video and audio files, etc.) imported into the application. Thesource files 3850 of some embodiments also store transcoded versions ofthe imported files as well as analysis data (e.g., people detectiondata, shake detection data, color balance data, etc.). The events data3855 stores the events information used by some embodiments to populatethe clip library and clip browser. The events data may be a set of clipobject data structures stored as one or more SQLite database files (orother format) in some embodiments. The project data 3860 stores theproject information used by some embodiments to specify a compositepresentation in the timeline. The project data may also be a set of clipobject data structures stored as one or more SQLite database files (orother format) in some embodiments. The layout data 3890 stores layoutinformation (e.g., coordinates, length, width, lane numbers, etc.) ofall clips that are displayed in the timeline. In some embodiments, thelayout data 3890 is part of the project data 3860. The render files 3865of some embodiments may include thumbnail-sized images for display inthe clip browser or timeline, audio waveform displays for media clips,as well as rendered segments of a timeline sequence for use in playback.In some embodiments, the four sets of data 3850-3865 are stored in onephysical storage (e.g., an internal hard drive, external hard drive,etc.). In some embodiments, the data may be split between multiplephysical storages. For instance, the source files might be stored on anexternal hard drive with the events data, project data, and render fileson an internal drive. Some embodiments store events data with theirassociated source files and render files in one set of folders, and theproject data with associated render files in a separate set of folders.

FIG. 38 also illustrates an operating system 3870 that includes inputdevice driver(s) 3875, display module 3880, and media import module3885. In some embodiments, as illustrated, the device drivers 38875,display module 3880, and media import module 3885 are part of theoperating system even when the media editing application 3800 is anapplication separate from the operating system.

The input device drivers 3875 may include drivers for translatingsignals from a keyboard, mouse, touchpad, tablet, touchscreen, etc. Auser interacts with one or more of these input device, which sendsignals to their corresponding device driver. The device driver thentranslates the signals into user input data that is provided to the UIinteraction and generation module 4305.

The present application describes a graphical user interface thatprovides users with numerous ways to perform different sets ofoperations and functionalities. In some embodiments, these operationsand functionalities are performed based on different commands that arereceived from users through different input devices (e.g., keyboard,trackpad, touchpad, mouse, etc.). For example, the present applicationillustrates the use of a cursor in the graphical user interface tocontrol (e.g., select, move) objects in the graphical user interface.However, in some embodiments, objects in the graphical user interfacecan also be controlled or manipulated through other controls, such astouch control. In some embodiments, touch control is implemented throughan input device that can detect the presence and location of touch on adisplay of the device. An example of such a device is a touch screendevice. In some embodiments, with touch control, a user can directlymanipulate objects by interacting with the graphical user interface thatis displayed on the display of the touch screen device. For instance, auser can select a particular object in the graphical user interface bysimply touching that particular object on the display of the touchscreen device. As such, when touch control is utilized, a cursor may noteven be provided for enabling selection of an object of a graphical userinterface in some embodiments. However, when a cursor is provided in agraphical user interface, touch control can be used to control thecursor in some embodiments.

The display module 3880 translates the output of a user interface for adisplay device. That is, the display module 3880 receives signals (e.g.,from the UI interaction and generation module 3805) describing whatshould be displayed and translates these signals into pixel informationthat is sent to the display device. The display device may be an LCD,plasma screen, CRT monitor, touchscreen, etc.

The media import module 3885 receives media files (e.g., audio files,video files, etc) from storage devices (e.g., external drives, recordingdevices, etc.) through one or more ports (e.g., a USB port, Firewireport, etc.) of the device on which the application 3800 operates andtranslates this media data for the media-editing application or storesthe data directly onto a storage of the device.

The UI interaction and generation module 3805 of the media editingapplication 3800 interprets the user input data received from the inputdevice drivers and passes it to various modules, including the mediaingest module 3810, the editing modules 3815, the rendering engine 3820,the playback module 3825, the timeline features module 3895, theplayhead control module 3830, the multi-track editor 3835, the precisioneditor 3845, and the timeline layout managers 3840. The UI interactionmodule also manages the display of the UI, and outputs this displayinformation to the display module 3880. This UI display information maybe based on information from the editing modules 3825, the playbackmodule 3825, the timeline features module 3895, the playhead controlmodule 3830, the multi-track editor 3835, the precision editor 3845, andthe data 3850, 3855, 3860, 3890, and 3865.

The media ingest module 3810 manages the import of source media into themedia-editing application 3800. Some embodiments, as shown, receivesource media from the media import module 3885 of the operating system3870. The media ingest module 3810 receives instructions through the UImodule 3805 as to which files should be imported, then instructs themedia import module 3885 to enable this import (e.g., from an externaldrive, from a camera, etc.). The media ingest module 3810 stores thesesource files 3850 in specific file folders associated with theapplication. In some embodiments, the media ingest module 3810 alsomanages the creation of event data structures upon import of sourcefiles and the creation of the clip and asset data structures containedin the events.

The editing modules 3815 include a variety of modules for editing mediain the clip browser as well as in the timeline. The editing modules 3815handle the creation of projects, addition and subtraction of clips fromprojects, trimming or other editing processes within the timeline (e.g.,inserting, deleting, anchoring, appending, etc.), application of effectsand transitions, or other editing processes. In some embodiments, theediting modules 3815 create and modify project and clip data structuresin both the event data 3855 and the project data 3860. Moreover, theediting modules 3815 works with the timeline layout managers 3840 tomanage the layouts of the clips and effects (e.g., transitions)displayed in the timeline.

The rendering engine 3820 handles the rendering of images for themedia-editing application. In some embodiments, the rendering enginemanages the creation of images for the media-editing application. Whenan image is requested by a destination within the application (e.g., theplayback module 3825) the rendering engine outputs the requested imageaccording to the project or event data. The rendering engine retrievesthe project data or event data that identifies how to create therequested image and generates a render graph that is a series of nodesindicating either images to retrieve from the source files or operationsto perform on the source files. In some embodiments, the renderingengine schedules the retrieval of the necessary images through disk readoperations and the decoding of those images.

The playback module 3825 handles the playback of images (e.g., in apreview display area of the user interface. Some embodiments do notinclude a playback module and the rendering engine directly outputs itsimages to the UI module 3810 for integration into the GUI, or directlyto the display module 3880 for display at a particular portion of thedisplay device.

In some embodiments, the render engine performs various operations togenerate an output image. In some embodiments, these operations includeblend operations, effects (e.g., blur or other pixel value modificationoperations), color space conversions, resolution transforms, etc. Insome embodiments, one or more of these processing operations areactually part of the operating system and are performed by a GPU or CPUof the device on which the application 3800 operates. The output of therendering engine (a rendered image) may be stored as render files instorage 3865 or sent to a destination for additional processing oroutput (e.g., playback).

The timeline layout managers 3840 manage the layouts of the clips andeffects (e.g., transitions) displayed in the timeline. For instance, thelayout managers 3840 update the layout data 3865 as media clips in thetimeline changes (e.g., by being edited, moved, deleted, etc.). Thetimeline layout managers 3840 interact with the editing modules 3815 toreceive editing operations performed on the items displayed in thetimeline. The timeline layout managers 3840 also interact with thenumerical editor 3845 as well to get any editing updates. In someembodiments, each timeline layout manager has a one-to-one relationshipwith the spine in managing the layouts of the clips that are in thespine or anchored to the clips in the spine. As described above, thetimeline layout managers 3840 may work with the editing modules 3815 inmanaging the layouts of the clips displayed in the timeline. Moreover,the layout managers 3815 in some embodiments perform the processes 1700and 1900 described above by reference to FIGS. 17 and 19 .

The timeline features module 3895 handles various features of thetimeline in some embodiments provide. For instance, the timelinefeatures module 3895 manages the separation of audio and video portionof a media clip displayed in the timeline. The timeline features module3895 also controls the volume of a media clip that has audio content.These timeline features are described above by reference to FIG. 2 . Thetimeline features module 3895 also communicates with the timeline layoutmanagers 3840 and the editing modules 3815 for handling any changes inthe layouts of the clips in the timeline and editing operationsperformed by using the provided timeline features.

The playhead control module 3830 manages playheads in the timeline insome embodiments. The playhead control module 3830 communicates with theediting modules 3815 to manage editing operations that are performed byusing playheads. For instance, the playhead control module 3830 workswith the editing modules 3815 for anchoring media clips based on theposition of the primary playhead in the timeline. The playheads of someembodiments are described above by reference to FIG. 2 .

The multi-track editor 3835 is a multi-track editing tool of someembodiments described above by reference to FIG. 22 . As describedabove, the multi-track editor opens a media clip within the timeline forediting in multi-tracks. This multi-track editor opens different trackscontained in a media clip in different lanes to allow the user to editindividual tracks of the media clip independently. In some embodiments,the multi-track editor 3835 communicates with the timeline layoutmanager 3840 and the editing modules 3815 when performing editoperations on the opened media clip.

The precision editor 3845 is a precision editing tool of someembodiments described above by reference to FIG. 23 . As describedabove, the precision editor splits the spine into two lanes and placeseach of two media clips to which a transition is applied in one of thetwo lanes for editing. In some embodiments, the precision editor 3835communicates with the timeline layout manager 3840 and the editingmodules 3815 when performing edit operations on the two media clips.

While many of the features of media-editing application 3800 have beendescribed as being performed by one module (e.g., the UI interaction andgeneration module 3805, the media ingest manager 3810, etc.), one ofordinary skill in the art will recognize that the functions describedherein might be split up into multiple modules. Similarly, functionsdescribed as being performed by multiple different modules might beperformed by a single module in some embodiments (e.g., the playbackmodule 3825 might be part of the UI interaction and generation module3805).

VII. Electronic System

Many of the above-described features and applications are implemented assoftware processes that are specified as a set of instructions recordedon a computer readable storage medium (also referred to as computerreadable medium). When these instructions are executed by one or morecomputational or processing unit(s) (e.g., one or more processors, coresof processors, or other processing units), they cause the processingunit(s) to perform the actions indicated in the instructions. Examplesof computer readable media include, but are not limited to, CD-ROMs,flash drives, random access memory (RAM) chips, hard drives, erasableprogrammable read only memories (EPROMs), electrically erasableprogrammable read-only memories (EEPROMs), etc. The computer readablemedia does not include carrier waves and electronic signals passingwirelessly or over wired connections.

In this specification, the term “software” is meant to include firmwareresiding in read-only memory or applications stored in magnetic storagewhich can be read into memory for processing by a processor. Also, insome embodiments, multiple software inventions can be implemented assub-parts of a larger program while remaining distinct softwareinventions. In some embodiments, multiple software inventions can alsobe implemented as separate programs. Finally, any combination ofseparate programs that together implement a software invention describedhere is within the scope of the invention. In some embodiments, thesoftware programs, when installed to operate on one or more electronicsystems, define one or more specific machine implementations thatexecute and perform the operations of the software programs.

FIG. 39 conceptually illustrates an electronic system 3900 with whichsome embodiments of the invention are implemented. The electronic system3900 may be a computer (e.g., a desktop computer, personal computer,tablet computer, etc.), phone, PDA, or any other sort of electronicdevice. Such an electronic system includes various types of computerreadable media and interfaces for various other types of computerreadable media. Electronic system 3900 includes a bus 3905, processingunit(s) 3910, a graphics processing unit (GPU) 3915, a system memory3920, a network 3925, a read-only memory 3930, a permanent storagedevice 3935, input devices 3940, and output devices 3945.

-   The bus 3905 collectively represents all system, peripheral, and    chipset buses that communicatively connect the numerous internal    devices of the electronic system 3900. For instance, the bus 3905    communicatively connects the processing unit(s) 3910 with the    read-only memory 3930, the GPU 3915, the system memory 3920, and the    permanent storage device 3935.

From these various memory units, the processing unit(s) 3910 retrievesinstructions to execute and data to process in order to execute theprocesses of the invention. The processing unit(s) may be a singleprocessor or a multi-core processor in different embodiments. Someinstructions are passed to and executed by the GPU 3915. The GPU 3915can offload various computations or complement the image processingprovided by the processing unit(s) 3910. In some embodiments, suchfunctionality can be provided using CoreImage's kernel shading language.

The read-only-memory (ROM) 3930 stores static data and instructions thatare needed by the processing unit(s) 3910 and other modules of theelectronic system. The permanent storage device 3935, on the other hand,is a read-and-write memory device. This device is a non-volatile memoryunit that stores instructions and data even when the electronic system3900 is off. Some embodiments of the invention use a mass-storage device(such as a magnetic or optical disk and its corresponding disk drive) asthe permanent storage device 3935.

Other embodiments use a removable storage device (such as a floppy disk,flash memory device, etc., and its corresponding disk drive) as thepermanent storage device. Like the permanent storage device 3935, thesystem memory 3920 is a read-and-write memory device. However, unlikestorage device 3935, the system memory 3920 is a volatile read-and-writememory, such as random access memory. The system memory 3920 stores someof the instructions and data that the processor needs at runtime. Insome embodiments, the invention's processes are stored in the systemmemory 3920, the permanent storage device 3935, and/or the read-onlymemory 3930. For example, the various memory units include instructionsfor processing multimedia clips in accordance with some embodiments.From these various memory units, the processing unit(s) 3910 retrievesinstructions to execute and data to process in order to execute theprocesses of some embodiments.

The bus 3905 also connects to the input and output devices 3940 and3945. The input devices 3940 enable the user to communicate informationand select commands to the electronic system. The input devices 3940include alphanumeric keyboards and pointing devices (also called “cursorcontrol devices”), cameras (e.g., webcams), microphones or similardevices for receiving voice commands, etc. The output devices 3945display images generated by the electronic system or otherwise outputdata. The output devices 3945 include printers and display devices, suchas cathode ray tubes (CRT) or liquid crystal displays (LCD), as well asspeakers or similar audio output devices. Some embodiments includedevices such as a touchscreen that function as both input and outputdevices.

Finally, as shown in FIG. 39 , bus 3905 also couples electronic system3900 to a network 3925 through a network adapter (not shown). In thismanner, the computer can be a part of a network of computers (such as alocal area network (“LAN”), a wide area network (“WAN”), or an Intranet,or a network of networks, such as the Internet. Any or all components ofelectronic system 3900 may be used in conjunction with the invention.

Some embodiments include electronic components, such as microprocessors,storage and memory that store computer program instructions in amachine-readable or computer-readable medium (alternatively referred toas computer-readable storage media, machine-readable media, ormachine-readable storage media). Some examples of such computer-readablemedia include RAM, ROM, read-only compact discs (CD-ROM), recordablecompact discs (CD-R), rewritable compact discs (CD-RW), read-onlydigital versatile discs (e.g., DVD-ROM, dual-layer DVD-ROM), a varietyof recordable/rewritable DVDs (e.g., DVD-RAM, DVD-RW, DVD+RW, etc.),flash memory (e.g., SD cards, mini-SD cards, micro-SD cards, etc.),magnetic and/or solid state hard drives, read-only and recordableBlu-Ray

discs, ultra density optical discs, any other optical or magnetic media,and floppy disks. The computer-readable media may store a computerprogram that is executable by at least one processing unit and includessets of instructions for performing various operations. Examples ofcomputer programs or computer code include machine code, such as isproduced by a compiler, and files including higher-level code that areexecuted by a computer, an electronic component, or a microprocessorusing an interpreter.

While the above discussion primarily refers to microprocessor ormulti-core processors that execute software, some embodiments areperformed by one or more integrated circuits, such as applicationspecific integrated circuits (ASICs) or field programmable gate arrays(FPGAs). In some embodiments, such integrated circuits executeinstructions that are stored on the circuit itself. In addition, someembodiments execute software stored in programmable logic devices(PLDs), ROM, or RAM devices.

As used in this specification and any claims of this application, theterms “computer”, “server”, “processor”, and “memory” all refer toelectronic or other technological devices. These terms exclude people orgroups of people. For the purposes of the specification, the termsdisplay or displaying means displaying on an electronic device. As usedin this specification and any claims of this application, the terms“computer readable medium,” “computer readable media,” and “machinereadable medium” are entirely restricted to tangible, physical objectsthat store information in a form that is readable by a computer. Theseterms exclude any wireless signals, wired download signals, and anyother ephemeral signals.

Although the above description of the various embodiments of theinvention show background-rendering operations performed for video, manyexamples of these background-rendering operations are applicable torendering audio as well. While the invention has been described withreference to numerous specific details, one of ordinary skill in the artwill recognize that the invention can be embodied in other specificforms without departing from the spirit of the invention. In addition, anumber of the figures (including FIGS. 17, 18, 21, 28, and 30 )conceptually illustrate processes. The specific operations of theseprocesses may not be performed in the exact order shown and described.The specific operations may not be performed in one continuous series ofoperations, and different specific operations may be performed indifferent embodiments. Furthermore, the process could be implementedusing several sub-processes, or as part of a larger macro process. Thus,one of ordinary skill in the art would understand that the invention isnot to be limited by the foregoing illustrative details, but rather isto be defined by the appended claims.

What is claimed is:
 1. A method for creating a media presentation from aplurality of media clips, the method comprising: displaying a compositedisplay area for placing media clips to specify the composite mediapresentation, the composite display area including a timeline thatincludes a plurality of lanes; displaying a set of media clips in thecomposite display area by placing each media clip in the set of mediaclips with correlated additional media content in an individual lane ofthe timeline, wherein the media clips and correlated additional mediacontent are from individual source files; receiving a single user inputcomprising a selection of one media clip from the set of media clips inthe composite display area, wherein the selected media clip includesdifferent types of media content and each type of media content includesa set of tracks; in response to receiving the single user inputcomprising the selection of the one media clip, replacing the set ofmedia clips in a visible portion of the plurality of lanes of thetimeline with: (a) a first set of one or more tracks corresponding to afirst type of media content, of the selected media clip, in a first setof one or more of the plurality of lanes; and (b) a second set of one ormore tracks corresponding to a second type of media content, of theselected media clip, in a second set of one or more of the plurality oflanes, wherein the timeline does not show any other media clips of theset of media clips subsequent to replacing the set of media clips in avisible portion of the timeline.
 2. The method of claim 1, wherein theset of lanes of the timeline comprises a primary lane for placing aprimary sequence of media clips and one or more secondary lanes forplacing media clips that are anchored to media clips in the primarylane.
 3. The method of claim 2, further comprising, in response todisplaying the set of tracks of the selected media clip in differentlanes of the timeline: displaying a particular track of a particularmedia content type of the selected media clip in the primary lane; anddisplaying other tracks of the particular media content type and othermedia content types in different secondary lanes of the compositedisplay area.
 4. The method of claim 1, further comprising: receiving auser input to trim a first media clip displayed in a particular lane ofthe timeline; in response to receiving the user input, trimming abeginning of the first media clip displayed in the particular lane; andin response to trimming the beginning of the first media clip, moving asecond media clip that is displayed before the first media clip in theparticular lane towards the first media clip as the first media clip isbeing trimmed.
 5. The method of claim 4, wherein the second media clipis moved without adding additional media content of the second mediaclip to an end of the second media clip closest to the first media clip.6. The method of claim 4, further comprising expanding a region of thetimeline that is positioned before the first media clip as the firstmedia clip is being trimmed.
 7. The method of claim 6, furthercomprising, in response to completion of the trimming of the first mediaclip, restoring a size of the region to an original size of the regionprior to the expanding.
 8. The method of claim 1, further comprising:trimming a first amount of media content from a first media clip; andincrementing first additional media content for the first media clip bythe first amount of media content trimmed off the first media clip.
 9. Anon-transitory machine readable medium storing a media-editingapplication for creating a media presentation from a plurality of mediaclips, the media-editing application comprising sets of instructionsfor: displaying a composite display area for placing media clips tospecify a composite media presentation, the composite display areaincluding a timeline that includes a plurality of lanes; displaying aset of media clips in the composite display area by placing each mediaclip in the set of media clips with correlated additional media contentin an individual lane of the timeline, wherein the media clips andcorrelated additional media content are from individual source files;receiving a single user input comprising a selection of one media clipfrom the set of media clips in the composite display area, wherein theselected media clip includes different types of media content and eachtype of media content includes a set of tracks; in response to receivingthe single user input comprising the selection of the one media clip,replacing the set of media clips in a visible portion of the pluralityof lanes of the timeline with: (a) a first set of one or more trackscorresponding to a first type of media content, of the selected mediaclip, in a first set of one or more of the plurality of lanes; and (b) asecond set of one or more tracks corresponding to a second type of mediacontent, of the selected media clip, in a second set of one or more ofthe plurality of lanes, wherein the timeline does not show any othermedia clips of the set of media clips subsequent to replacing the set ofmedia clips in a visible portion of the timeline.
 10. The non-transitorymachine readable medium of claim 9, wherein the set of lanes of thetimeline comprises a primary lane for placing a primary sequence ofmedia clips and one or more secondary lanes for placing media clips thatare anchored to media clips in the primary lane.
 11. The non-transitorymachine readable medium of claim 10, wherein the media-editingapplication further comprises sets of instructions for, in response todisplaying the set of tracks of the selected media clip in differentlanes of the timeline: displaying a particular track of a particularmedia content type of the selected media clip in the primary lane; anddisplaying other tracks of the particular media content type and othermedia content types in different secondary lanes of the compositedisplay area.
 12. The non-transitory machine readable medium of claim 9,wherein the media-editing application further comprises sets ofinstructions for: receiving a user input to trim a first media clipdisplayed in a particular lane of the timeline; in response to receivingthe user input, trimming a beginning of the first media clip displayedin the particular lane; and in response to trimming the beginning of thefirst media clip, moving a second media clip that is displayed beforethe first media clip in the particular lane towards the first media clipas the first media clip is being trimmed.
 13. The non-transitory machinereadable medium of claim 12, wherein the second media clip is movedwithout adding additional media content of the second media clip to anend of the second media clip closest to the first media clip.
 14. Thenon-transitory machine readable medium of claim 12, wherein themedia-editing application further comprises a set of instructions forexpanding a region of the timeline that is positioned before the firstmedia clip as the first media clip is being trimmed.
 15. Thenon-transitory machine readable medium of claim 14, wherein themedia-editing application further comprises a set of instructions for,in response to completion of the trimming of the first media clip,restoring a size of the region to an original size of the region priorto the expanding.
 16. The non-transitory machine readable medium ofclaim 9, wherein the media-editing application further comprises sets ofinstructions for: trimming a first amount of media content from a firstmedia clip; and incrementing first additional media content for thefirst media clip by the first amount of media content trimmed off thefirst media clip.
 17. A system comprising: one or more processors; and anon-transitory machine readable medium storing a media-editingapplication for creating a media presentation from a plurality of mediaclips, the media-editing application comprising sets of instructions,that when executed by the one or more processors, cause: displaying acomposite display area for placing media clips to specify the compositemedia presentation, the composite display area including a timeline thatincludes a plurality of lanes; displaying a set of media clips in thecomposite display area by placing each media clip in the set of mediaclips with correlated additional media content in an individual lane ofthe timeline, wherein the media clips and correlated additional mediacontent are from individual source files; receiving a single user inputcomprising a selection of one media clip from the set of media clips inthe composite display area, wherein the selected media clip includesdifferent types of media content and each type of media content includesa set of tracks; in response to receiving the single user inputcomprising the selection of the one media clip, replacing the set ofmedia clips in a visible portion of the plurality of lanes of thetimeline with: (a) a first set of one or more tracks corresponding to afirst type of media content, of the selected media clip, in a first setof one or more of the plurality of lanes; and (b) a second set of one ormore tracks corresponding to a second type of media content, of theselected media clip, in a second set of one or more of the plurality oflanes, wherein the timeline does not show any other media clips of theset of media clips subsequent to replacing the set of media clips in thevisible portion of the timeline.
 18. The system of claim 17, wherein theset of lanes of the timeline comprises a primary lane for placing aprimary sequence of media clips and one or more secondary lanes forplacing media clips that are anchored to media clips in the primarylane, and wherein the media-editing application further comprises setsof instructions that cause, in response to displaying the set of tracksof the selected media clip in different lanes of the timeline:displaying a particular track of a particular media content type of theselected media clip in the primary lane; and displaying other tracks ofthe particular media content type and other media content types indifferent secondary lanes of the composite display area.
 19. The systemof claim 17, wherein the media-editing application further comprisessets of instructions that cause: expanding a region of the timeline thatis positioned before a first media clip as the first media clip is beingtrimmed; and in response to completion of the trimming of the firstmedia clip, restoring a size of the region to an original size of theregion prior to the expanding.
 20. The system of claim 17, wherein themedia-editing application further comprises sets of instructions thatcause: receiving a user input to trim a first media clip displayed in aparticular lane of the timeline; in response to receiving the userinput, trimming a beginning of the first media clip displayed in theparticular lane; and in response to trimming the beginning of the firstmedia clip, moving a second media clip that is displayed before thefirst media clip in the particular lane towards the first media clip asthe first media clip is being trimmed.